提交 9c55d7e0 编写于 作者: T Travis CI

Deploy to GitHub Pages: 41d05339

上级 a6bc8fa1
...@@ -205,7 +205,7 @@ ...@@ -205,7 +205,7 @@
<dd><p>Momentum Optimizer.</p> <dd><p>Momentum Optimizer.</p>
<p>When sparse=False, the momentum update formula is as follows:</p> <p>When sparse=False, the momentum update formula is as follows:</p>
<div class="math"> <div class="math">
\[\begin{split}v_{t} &amp;= k * v_{t-1} - \gamma_t / (g_{t} + \lambda w_{t-1}) \\ \[\begin{split}v_{t} &amp;= k * v_{t-1} - \gamma_t (g_{t} + \lambda w_{t-1}) \\
w_{t} &amp;= w_{t-1} + v_{t} \\\end{split}\]</div> w_{t} &amp;= w_{t-1} + v_{t} \\\end{split}\]</div>
<p>where, <span class="math">\(k\)</span> is momentum, <span class="math">\(\lambda\)</span> is decay rate, <p>where, <span class="math">\(k\)</span> is momentum, <span class="math">\(\lambda\)</span> is decay rate,
<span class="math">\(\gamma_t\)</span> is learning rate at the t&#8217;th iteration. <span class="math">\(\gamma_t\)</span> is learning rate at the t&#8217;th iteration.
......
...@@ -219,7 +219,7 @@ ...@@ -219,7 +219,7 @@
<dd><p>Momentum Optimizer.</p> <dd><p>Momentum Optimizer.</p>
<p>When sparse=False, the momentum update formula is as follows:</p> <p>When sparse=False, the momentum update formula is as follows:</p>
<div class="math"> <div class="math">
\[\begin{split}v_{t} &amp;= k * v_{t-1} - \gamma_t / (g_{t} + \lambda w_{t-1}) \\ \[\begin{split}v_{t} &amp;= k * v_{t-1} - \gamma_t (g_{t} + \lambda w_{t-1}) \\
w_{t} &amp;= w_{t-1} + v_{t} \\\end{split}\]</div> w_{t} &amp;= w_{t-1} + v_{t} \\\end{split}\]</div>
<p>where, <span class="math">\(k\)</span> is momentum, <span class="math">\(\lambda\)</span> is decay rate, <p>where, <span class="math">\(k\)</span> is momentum, <span class="math">\(\lambda\)</span> is decay rate,
<span class="math">\(\gamma_t\)</span> is learning rate at the t&#8217;th iteration. <span class="math">\(\gamma_t\)</span> is learning rate at the t&#8217;th iteration.
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册