提交 2b7ebce3 编写于 作者: V Varuna Jayasiri

distillation fix

上级 e0d4b658
......@@ -324,7 +324,7 @@ by a factor of $T^2$</p>
</p>
</div>
<div class='code'>
<div class="highlight"><pre><span class="lineno">143</span> <span class="n">soft_prob</span> <span class="o">=</span> <span class="n">nn</span><span class="o">.</span><span class="n">functional</span><span class="o">.</span><span class="n">log_softmax</span><span class="p">(</span><span class="n">large_logits</span> <span class="o">/</span> <span class="bp">self</span><span class="o">.</span><span class="n">temperature</span><span class="p">,</span> <span class="n">dim</span><span class="o">=-</span><span class="mi">1</span><span class="p">)</span></pre></div>
<div class="highlight"><pre><span class="lineno">143</span> <span class="n">soft_prob</span> <span class="o">=</span> <span class="n">nn</span><span class="o">.</span><span class="n">functional</span><span class="o">.</span><span class="n">log_softmax</span><span class="p">(</span><span class="n">output</span> <span class="o">/</span> <span class="bp">self</span><span class="o">.</span><span class="n">temperature</span><span class="p">,</span> <span class="n">dim</span><span class="o">=-</span><span class="mi">1</span><span class="p">)</span></pre></div>
</div>
</div>
<div class='section' id='section-18'>
......
......@@ -316,7 +316,7 @@
<url>
<loc>https://nn.labml.ai/distillation/index.html</loc>
<lastmod>2021-07-03T16:30:00+00:00</lastmod>
<lastmod>2021-07-12T16:30:00+00:00</lastmod>
<priority>1.00</priority>
</url>
......@@ -337,7 +337,7 @@
<url>
<loc>https://nn.labml.ai/index.html</loc>
<lastmod>2021-07-03T16:30:00+00:00</lastmod>
<lastmod>2021-07-08T16:30:00+00:00</lastmod>
<priority>1.00</priority>
</url>
......@@ -834,7 +834,7 @@
<url>
<loc>https://nn.labml.ai/graphs/index.html</loc>
<lastmod>2021-07-07T16:30:00+00:00</lastmod>
<lastmod>2021-07-08T16:30:00+00:00</lastmod>
<priority>1.00</priority>
</url>
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册