How do I properly continue finetuning a checkpoint?
Created by: drunkinlove
When I attempt to continue finetuning using checkpoint (that was the result of another finetuning procedure), the model stagnates after a while. Basically, I get identical predictions after every epoch. Is this a known problem, maybe I'm doing something incorrectly? To initialize finetuning with a checkpoint, I use the "--init_checkpoint" argument.