Is it possible to change the optimizer after N no. of steps?
Created by: alvations
For example, I want to take 500 batches with ADAM and then afterwards change to SGD where each epoch has around 10,000 batches. Is there a way to do it with paddle train
?
Or can I only change the optimizer after a pass is finished and I stop the training manually and re-run paddle train
with the new settings?