提交 78e29521 编写于 作者: G guosheng

Add bias for the fc layers in positionwise_feed_forward

上级 e4392454
...@@ -142,13 +142,9 @@ def positionwise_feed_forward(x, d_inner_hid, d_hid): ...@@ -142,13 +142,9 @@ def positionwise_feed_forward(x, d_inner_hid, d_hid):
""" """
hidden = layers.fc(input=x, hidden = layers.fc(input=x,
size=d_inner_hid, size=d_inner_hid,
bias_attr=False,
num_flatten_dims=2, num_flatten_dims=2,
act="relu") act="relu")
out = layers.fc(input=hidden, out = layers.fc(input=hidden, size=d_hid, num_flatten_dims=2)
size=d_hid,
bias_attr=False,
num_flatten_dims=2)
return out return out
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册