Skip to content

P
Paddle

PaddlePaddle / Paddle
大约 1 年 前同步成功

通知 2299
Star 20931
Fork 5422
P
Paddle
切换分支/标签
查找文件 普通视图历史永久链接Permalink
index.html 12.1 KB
Newer Older
Y
Add old releases documentation  
Yu Yang 已提交
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 


<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
  "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">


<html xmlns="http://www.w3.org/1999/xhtml">
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
    
    <title>Activations &#8212; PaddlePaddle  documentation</title>
    
    <link rel="stylesheet" href="../../../_static/classic.css" type="text/css" />
    <link rel="stylesheet" href="../../../_static/pygments.css" type="text/css" />
    
    <script type="text/javascript">
      var DOCUMENTATION_OPTIONS = {
        URL_ROOT:    '../../../',
        VERSION:     '',
        COLLAPSE_INDEX: false,
        FILE_SUFFIX: '.html',
        HAS_SOURCE:  true
      };
    </script>
    <script type="text/javascript" src="../../../_static/jquery.js"></script>
    <script type="text/javascript" src="../../../_static/underscore.js"></script>
    <script type="text/javascript" src="../../../_static/doctools.js"></script>
    <script type="text/javascript" src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script>
    <link rel="index" title="Index" href="../../../genindex.html" />
    <link rel="search" title="Search" href="../../../search.html" />
    <link rel="top" title="PaddlePaddle  documentation" href="../../../index.html" />
    <link rel="up" title="Source Code Documents" href="../../index.html" />
    <link rel="next" title="Data Providers Documents" href="../dataprovider/index.html" />
    <link rel="prev" title="Utilities" href="../../cuda/utils/utils.html" /> 
<script>
var _hmt = _hmt || [];
(function() {
  var hm = document.createElement("script");
  hm.src = "//hm.baidu.com/hm.js?b9a314ab40d04d805655aab1deee08ba";
  var s = document.getElementsByTagName("script")[0]; 
  s.parentNode.insertBefore(hm, s);
})();
</script>

  </head>
  <body role="document">
    <div class="related" role="navigation" aria-label="related navigation">
      <h3>Navigation</h3>
      <ul>
        <li class="right" style="margin-right: 10px">
          <a href="../../../genindex.html" title="General Index"
             accesskey="I">index</a></li>
        <li class="right" >
          <a href="../../../py-modindex.html" title="Python Module Index"
             >modules</a> |</li>
        <li class="right" >
          <a href="../dataprovider/index.html" title="Data Providers Documents"
             accesskey="N">next</a> |</li>
        <li class="right" >
          <a href="../../cuda/utils/utils.html" title="Utilities"
             accesskey="P">previous</a> |</li>
        <li class="nav-item nav-item-0"><a href="../../../index.html">PaddlePaddle  documentation</a> &#187;</li>
          <li class="nav-item nav-item-1"><a href="../../index.html" accesskey="U">Source Code Documents</a> &#187;</li> 
      </ul>
    </div>  

    <div class="document">
      <div class="documentwrapper">
        <div class="bodywrapper">
          <div class="body" role="main">
            
  <div class="section" id="activations">
<h1>Activations<a class="headerlink" href="#activations" title="Permalink to this headline"></a></h1>
<dl class="class">
<dt id="_CPPv2N6paddle18ActivationFunctionE">
<span id="paddle::ActivationFunction"></span><span class="target" id="paddleclasspaddle_1_1ActivationFunction"></span><em class="property">class </em><code class="descclassname">paddle::</code><code class="descname">ActivationFunction</code><a class="headerlink" href="#_CPPv2N6paddle18ActivationFunctionE" title="Permalink to this definition"></a></dt>
<dd><p>Activation function is a function that transforms a set of input signals into an output signals. The purpose of the activation function is to introduce non-liearilty into the network. </p>
<p><dl class="docutils">
<dt><strong>Note</strong></dt>
<dd>Common activation function are provieded, including linear, sigmoid, softmax, sequence_max, relu, brelu, tanh, stanh, softrelu, abs, square, exponential. </dd>
</dl>
</p>
<p>Subclassed by paddle::IdentityActivation</p>
<div class="breathe-sectiondef container">
<p class="breathe-sectiondef-title rubric">Public Functions</p>
<dl class="function">
<dt id="_CPPv2N6paddle18ActivationFunction18ActivationFunctionEv">
<span id="paddle::ActivationFunction::ActivationFunction"></span><span class="target" id="paddleclasspaddle_1_1ActivationFunction_1a99d16fa7744ab01eba956b3cb49aa0e2"></span><code class="descname">ActivationFunction</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#_CPPv2N6paddle18ActivationFunction18ActivationFunctionEv" title="Permalink to this definition"></a></dt>
<dd></dd></dl>

<dl class="function">
<dt id="_CPPv2N6paddle18ActivationFunctionD0Ev">
<span id="paddle::ActivationFunction::~ActivationFunction"></span><span class="target" id="paddleclasspaddle_1_1ActivationFunction_1a97992626b45a327e1d9f405b51d11deb"></span><em class="property">virtual</em> <code class="descname">~ActivationFunction</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#_CPPv2N6paddle18ActivationFunctionD0Ev" title="Permalink to this definition"></a></dt>
<dd></dd></dl>

<dl class="function">
<dt id="_CPPv2N6paddle18ActivationFunction7forwardER8Argument">
<span id="paddle::ActivationFunction::forward__ArgumentR"></span><span class="target" id="paddleclasspaddle_1_1ActivationFunction_1a3d2d82f5548cff294b93d37f08559fe4"></span><em class="property">virtual</em> void <code class="descname">forward</code><span class="sig-paren">(</span><a class="reference internal" href="../../parameter/parameter/parameter.html#_CPPv2N6paddle8ArgumentE" title="paddle::Argument">Argument</a> &amp;<em>act</em><span class="sig-paren">)</span> = 0<a class="headerlink" href="#_CPPv2N6paddle18ActivationFunction7forwardER8Argument" title="Permalink to this definition"></a></dt>
<dd><p>Foward propagation. </p>
<p>act.value &lt;- f(act.value), where f is the activation function. Suppose that before calling <a class="reference internal" href="#paddleclasspaddle_1_1ActivationFunction_1a3d2d82f5548cff294b93d37f08559fe4"><span class="std std-ref">forward()</span></a>, act.value is x and after <a class="reference internal" href="#paddleclasspaddle_1_1ActivationFunction_1a3d2d82f5548cff294b93d37f08559fe4"><span class="std std-ref">forward()</span></a> is called, act.value is y, then y = f(x).</p>
<p>Usually, act is <a class="reference internal" href="../layers/layer.html#paddleclasspaddle_1_1Layer_1a955c467f7d96f46d8e2ea0e995137097"><span class="std std-ref">Layer::output_</span></a> </p>
</dd></dl>

<dl class="function">
<dt id="_CPPv2N6paddle18ActivationFunction8backwardER8Argument">
<span id="paddle::ActivationFunction::backward__ArgumentR"></span><span class="target" id="paddleclasspaddle_1_1ActivationFunction_1aa567f66ac2dea1f209b6de8134634c4a"></span><em class="property">virtual</em> void <code class="descname">backward</code><span class="sig-paren">(</span><a class="reference internal" href="../../parameter/parameter/parameter.html#_CPPv2N6paddle8ArgumentE" title="paddle::Argument">Argument</a> &amp;<em>act</em><span class="sig-paren">)</span> = 0<a class="headerlink" href="#_CPPv2N6paddle18ActivationFunction8backwardER8Argument" title="Permalink to this definition"></a></dt>
<dd><p>Backward propagaion. </p>
<p>x and y are defined in the above comment for <a class="reference internal" href="#paddleclasspaddle_1_1ActivationFunction_1a3d2d82f5548cff294b93d37f08559fe4"><span class="std std-ref">forward()</span></a>.<ul class="simple">
<li>Before calling <a class="reference internal" href="#paddleclasspaddle_1_1ActivationFunction_1aa567f66ac2dea1f209b6de8134634c4a"><span class="std std-ref">backward()</span></a>, act.grad = dE / dy, where E is the error/cost</li>
<li>After <a class="reference internal" href="#paddleclasspaddle_1_1ActivationFunction_1aa567f66ac2dea1f209b6de8134634c4a"><span class="std std-ref">backward()</span></a> returns, act.grad = dE / dx = (dE/dy) * (dy/dx) </li>
</ul>
</p>
</dd></dl>

<dl class="function">
<dt id="_CPPv2NK6paddle18ActivationFunction7getNameEv">
<span id="paddle::ActivationFunction::getNameC"></span><span class="target" id="paddleclasspaddle_1_1ActivationFunction_1aea8876019ab52ac0329d5f856ea1458c"></span><em class="property">virtual</em> <em class="property">const</em> std::string &amp;<code class="descname">getName</code><span class="sig-paren">(</span><span class="sig-paren">)</span> <em class="property">const</em> = 0<a class="headerlink" href="#_CPPv2NK6paddle18ActivationFunction7getNameEv" title="Permalink to this definition"></a></dt>
<dd></dd></dl>

</div>
<div class="breathe-sectiondef container">
<p class="breathe-sectiondef-title rubric">Public Static Functions</p>
<dl class="function">
<dt id="_CPPv2N6paddle18ActivationFunction6createERKNSt6stringE">
<span id="paddle::ActivationFunction::create__ssCR"></span><span class="target" id="paddleclasspaddle_1_1ActivationFunction_1ace0afca87b53041d4e2e603a536bc230"></span><a class="reference internal" href="#_CPPv2N6paddle18ActivationFunctionE" title="paddle::ActivationFunction">ActivationFunction</a> *<code class="descname">create</code><span class="sig-paren">(</span><em class="property">const</em> std::string &amp;<em>type</em><span class="sig-paren">)</span><a class="headerlink" href="#_CPPv2N6paddle18ActivationFunction6createERKNSt6stringE" title="Permalink to this definition"></a></dt>
<dd></dd></dl>

<dl class="function">
<dt id="_CPPv2N6paddle18ActivationFunction21getAllRegisteredTypesEv">
<span id="paddle::ActivationFunction::getAllRegisteredTypes"></span><span class="target" id="paddleclasspaddle_1_1ActivationFunction_1af651fa503dc54ab52d807803ac00f78b"></span>std::vector&lt;std::string&gt; <code class="descname">getAllRegisteredTypes</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#_CPPv2N6paddle18ActivationFunction21getAllRegisteredTypesEv" title="Permalink to this definition"></a></dt>
<dd></dd></dl>

</div>
</dd></dl>

</div>


          </div>
        </div>
      </div>
      <div class="sphinxsidebar" role="navigation" aria-label="main navigation">
        <div class="sphinxsidebarwrapper">
  <h4>Previous topic</h4>
  <p class="topless"><a href="../../cuda/utils/utils.html"
                        title="previous chapter">Utilities</a></p>
  <h4>Next topic</h4>
  <p class="topless"><a href="../dataprovider/index.html"
                        title="next chapter">Data Providers Documents</a></p>
  <div role="note" aria-label="source link">
    <h3>This Page</h3>
    <ul class="this-page-menu">
      <li><a href="../../../_sources/source/gserver/activations/index.txt"
            rel="nofollow">Show Source</a></li>
    </ul>
   </div>
<div id="searchbox" style="display: none" role="search">
  <h3>Quick search</h3>
    <form class="search" action="../../../search.html" method="get">
      <div><input type="text" name="q" /></div>
      <div><input type="submit" value="Go" /></div>
      <input type="hidden" name="check_keywords" value="yes" />
      <input type="hidden" name="area" value="default" />
    </form>
</div>
<script type="text/javascript">$('#searchbox').show(0);</script>
        </div>
      </div>
      <div class="clearer"></div>
    </div>
    <div class="related" role="navigation" aria-label="related navigation">
      <h3>Navigation</h3>
      <ul>
        <li class="right" style="margin-right: 10px">
          <a href="../../../genindex.html" title="General Index"
             >index</a></li>
        <li class="right" >
          <a href="../../../py-modindex.html" title="Python Module Index"
             >modules</a> |</li>
        <li class="right" >
          <a href="../dataprovider/index.html" title="Data Providers Documents"
             >next</a> |</li>
        <li class="right" >
          <a href="../../cuda/utils/utils.html" title="Utilities"
             >previous</a> |</li>
        <li class="nav-item nav-item-0"><a href="../../../index.html">PaddlePaddle  documentation</a> &#187;</li>
          <li class="nav-item nav-item-1"><a href="../../index.html" >Source Code Documents</a> &#187;</li> 
      </ul>
    </div>
    <div class="footer" role="contentinfo">
        &#169; Copyright 2016, PaddlePaddle developers.
      Created using <a href="http://sphinx-doc.org/">Sphinx</a> 1.4.9.
    </div>
  </body>
</html>