提交 2073fb96 编写于 作者: Y Yibing Liu

Enable learning rate annealing of Adam Optimizer

上级 c8c4ba0f
...@@ -265,6 +265,10 @@ public: ...@@ -265,6 +265,10 @@ public:
addParameterType(PARAMETER_SECOND_MOMENTUM); addParameterType(PARAMETER_SECOND_MOMENTUM);
} }
virtual void startBatch(int64_t numSamplesProcessed) {
learningRate_ = calcLearningRate(numSamplesProcessed, pass_);
}
virtual void finishBatch() { ++step_; } virtual void finishBatch() { ++step_; }
virtual void update(const VectorPtr vecs[], virtual void update(const VectorPtr vecs[],
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册