提交 78e29521 编写于 作者: G guosheng

Add bias for the fc layers in positionwise_feed_forward

上级 e4392454
......@@ -142,13 +142,9 @@ def positionwise_feed_forward(x, d_inner_hid, d_hid):
"""
hidden = layers.fc(input=x,
size=d_inner_hid,
bias_attr=False,
num_flatten_dims=2,
act="relu")
out = layers.fc(input=hidden,
size=d_hid,
bias_attr=False,
num_flatten_dims=2)
out = layers.fc(input=hidden, size=d_hid, num_flatten_dims=2)
return out
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册