训练的时候加载的外部预训练的embedding也作为参数参加训练
Created by: WoNiuHu
hi,RT。CNN-non-static: Same as above but the pretrained vectors are fine-tuned for each task. 加载embedding层的语句,
emb = embedding_layer(input=data, size=emb_dim, param_attr=ParamAttr(name='_source_language_embedding'))`
emb_para = ParameterAttribute(name='emb', initial_std=0., learning_rate=0.)
fc1 = fc_layer(input=emb, size=hid_dim, act=linear, bias_attr=bias_attr, param_attr=emb_para)
是这样处理?不确定是不是加对了?