From 9c55d7e0e0a30ce5ebc6f2c5e49936ed3647dddd Mon Sep 17 00:00:00 2001 From: Travis CI Date: Thu, 9 Nov 2017 11:34:01 +0000 Subject: [PATCH] Deploy to GitHub Pages: 41d053393299aec925ffdc025ebf0e24cd2a850c --- develop/doc/api/v2/config/optimizer.html | 2 +- develop/doc_cn/api/v2/config/optimizer.html | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/develop/doc/api/v2/config/optimizer.html b/develop/doc/api/v2/config/optimizer.html index 5233b7ae2ad..6e90175c955 100644 --- a/develop/doc/api/v2/config/optimizer.html +++ b/develop/doc/api/v2/config/optimizer.html @@ -205,7 +205,7 @@

Momentum Optimizer.

When sparse=False, the momentum update formula is as follows:

-\[\begin{split}v_{t} &= k * v_{t-1} - \gamma_t / (g_{t} + \lambda w_{t-1}) \\ +\[\begin{split}v_{t} &= k * v_{t-1} - \gamma_t (g_{t} + \lambda w_{t-1}) \\ w_{t} &= w_{t-1} + v_{t} \\\end{split}\]

where, \(k\) is momentum, \(\lambda\) is decay rate, \(\gamma_t\) is learning rate at the t’th iteration. diff --git a/develop/doc_cn/api/v2/config/optimizer.html b/develop/doc_cn/api/v2/config/optimizer.html index 62b5f70a59e..26a55e0b9fc 100644 --- a/develop/doc_cn/api/v2/config/optimizer.html +++ b/develop/doc_cn/api/v2/config/optimizer.html @@ -219,7 +219,7 @@

Momentum Optimizer.

When sparse=False, the momentum update formula is as follows:

-\[\begin{split}v_{t} &= k * v_{t-1} - \gamma_t / (g_{t} + \lambda w_{t-1}) \\ +\[\begin{split}v_{t} &= k * v_{t-1} - \gamma_t (g_{t} + \lambda w_{t-1}) \\ w_{t} &= w_{t-1} + v_{t} \\\end{split}\]

where, \(k\) is momentum, \(\lambda\) is decay rate, \(\gamma_t\) is learning rate at the t’th iteration. -- GitLab