提交 a219f3cc 编写于 作者: X Xin Pan

follow comments

上级 4a0f3743
...@@ -209,6 +209,18 @@ def polynomial_decay(learning_rate, ...@@ -209,6 +209,18 @@ def polynomial_decay(learning_rate,
def piecewise_decay(boundaries, values): def piecewise_decay(boundaries, values):
"""Applies piecewise decay to the initial learning rate. """Applies piecewise decay to the initial learning rate.
The algorithm can be described as the code below.
.. code-block:: python
boundaries = [10000, 20000]
values = [1.0, 0.5, 0.1]
if step < 10000:
learning_rate = 1.0
elif 10000 <= step < 20000:
learning_rate = 0.5
else:
learning_rate = 0.1
Args: Args:
boundaries: A list of steps numbers. boundaries: A list of steps numbers.
values: A list of learning rate values that will be picked during values: A list of learning rate values that will be picked during
...@@ -217,15 +229,7 @@ def piecewise_decay(boundaries, values): ...@@ -217,15 +229,7 @@ def piecewise_decay(boundaries, values):
Returns: Returns:
The decayed learning rate. The decayed learning rate.
>>> boundaries = [10000, 20000]
>>> values = [1.0, 0.5, 0.1]
>>>
>>> if step < 10000:
>>> learning_rate = 1.0
>>> elif 10000 <= step < 20000:
>>> learning_rate = 0.5
>>> else:
>>> learning_rate = 0.1
""" """
if len(values) - len(boundaries) != 1: if len(values) - len(boundaries) != 1:
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册