Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
PaddlePaddle
PALM
提交
ec741693
P
PALM
项目概览
PaddlePaddle
/
PALM
通知
8
Star
3
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
10
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
PALM
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
10
Issue
10
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
ec741693
编写于
12月 04, 2019
作者:
W
wangxiao
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
change to fluid.embedding
上级
6c617d52
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
7 addition
and
7 deletion
+7
-7
paddlepalm/backbone/bert.py
paddlepalm/backbone/bert.py
+3
-3
paddlepalm/backbone/ernie.py
paddlepalm/backbone/ernie.py
+4
-4
未找到文件。
paddlepalm/backbone/bert.py
浏览文件 @
ec741693
...
@@ -73,7 +73,7 @@ class Model(backbone):
...
@@ -73,7 +73,7 @@ class Model(backbone):
self
.
_emb_dtype
=
'float32'
self
.
_emb_dtype
=
'float32'
# padding id in vocabulary must be set to 0
# padding id in vocabulary must be set to 0
emb_out
=
fluid
.
layers
.
embedding
(
emb_out
=
fluid
.
embedding
(
input
=
src_ids
,
input
=
src_ids
,
size
=
[
self
.
_voc_size
,
self
.
_emb_size
],
size
=
[
self
.
_voc_size
,
self
.
_emb_size
],
dtype
=
self
.
_emb_dtype
,
dtype
=
self
.
_emb_dtype
,
...
@@ -84,14 +84,14 @@ class Model(backbone):
...
@@ -84,14 +84,14 @@ class Model(backbone):
# fluid.global_scope().find_var('backbone-word_embedding').get_tensor()
# fluid.global_scope().find_var('backbone-word_embedding').get_tensor()
embedding_table
=
fluid
.
default_main_program
().
global_block
().
var
(
scope_name
+
self
.
_word_emb_name
)
embedding_table
=
fluid
.
default_main_program
().
global_block
().
var
(
scope_name
+
self
.
_word_emb_name
)
position_emb_out
=
fluid
.
layers
.
embedding
(
position_emb_out
=
fluid
.
embedding
(
input
=
pos_ids
,
input
=
pos_ids
,
size
=
[
self
.
_max_position_seq_len
,
self
.
_emb_size
],
size
=
[
self
.
_max_position_seq_len
,
self
.
_emb_size
],
dtype
=
self
.
_emb_dtype
,
dtype
=
self
.
_emb_dtype
,
param_attr
=
fluid
.
ParamAttr
(
param_attr
=
fluid
.
ParamAttr
(
name
=
scope_name
+
self
.
_pos_emb_name
,
initializer
=
self
.
_param_initializer
))
name
=
scope_name
+
self
.
_pos_emb_name
,
initializer
=
self
.
_param_initializer
))
sent_emb_out
=
fluid
.
layers
.
embedding
(
sent_emb_out
=
fluid
.
embedding
(
sent_ids
,
sent_ids
,
size
=
[
self
.
_sent_types
,
self
.
_emb_size
],
size
=
[
self
.
_sent_types
,
self
.
_emb_size
],
dtype
=
self
.
_emb_dtype
,
dtype
=
self
.
_emb_dtype
,
...
...
paddlepalm/backbone/ernie.py
浏览文件 @
ec741693
...
@@ -85,7 +85,7 @@ class Model(backbone):
...
@@ -85,7 +85,7 @@ class Model(backbone):
task_ids
=
inputs
[
'task_ids'
]
task_ids
=
inputs
[
'task_ids'
]
# padding id in vocabulary must be set to 0
# padding id in vocabulary must be set to 0
emb_out
=
fluid
.
layers
.
embedding
(
emb_out
=
fluid
.
embedding
(
input
=
src_ids
,
input
=
src_ids
,
size
=
[
self
.
_voc_size
,
self
.
_emb_size
],
size
=
[
self
.
_voc_size
,
self
.
_emb_size
],
dtype
=
self
.
_emb_dtype
,
dtype
=
self
.
_emb_dtype
,
...
@@ -96,14 +96,14 @@ class Model(backbone):
...
@@ -96,14 +96,14 @@ class Model(backbone):
# fluid.global_scope().find_var('backbone-word_embedding').get_tensor()
# fluid.global_scope().find_var('backbone-word_embedding').get_tensor()
embedding_table
=
fluid
.
default_main_program
().
global_block
().
var
(
scope_name
+
self
.
_word_emb_name
)
embedding_table
=
fluid
.
default_main_program
().
global_block
().
var
(
scope_name
+
self
.
_word_emb_name
)
position_emb_out
=
fluid
.
layers
.
embedding
(
position_emb_out
=
fluid
.
embedding
(
input
=
pos_ids
,
input
=
pos_ids
,
size
=
[
self
.
_max_position_seq_len
,
self
.
_emb_size
],
size
=
[
self
.
_max_position_seq_len
,
self
.
_emb_size
],
dtype
=
self
.
_emb_dtype
,
dtype
=
self
.
_emb_dtype
,
param_attr
=
fluid
.
ParamAttr
(
param_attr
=
fluid
.
ParamAttr
(
name
=
scope_name
+
self
.
_pos_emb_name
,
initializer
=
self
.
_param_initializer
))
name
=
scope_name
+
self
.
_pos_emb_name
,
initializer
=
self
.
_param_initializer
))
sent_emb_out
=
fluid
.
layers
.
embedding
(
sent_emb_out
=
fluid
.
embedding
(
sent_ids
,
sent_ids
,
size
=
[
self
.
_sent_types
,
self
.
_emb_size
],
size
=
[
self
.
_sent_types
,
self
.
_emb_size
],
dtype
=
self
.
_emb_dtype
,
dtype
=
self
.
_emb_dtype
,
...
@@ -113,7 +113,7 @@ class Model(backbone):
...
@@ -113,7 +113,7 @@ class Model(backbone):
emb_out
=
emb_out
+
position_emb_out
emb_out
=
emb_out
+
position_emb_out
emb_out
=
emb_out
+
sent_emb_out
emb_out
=
emb_out
+
sent_emb_out
task_emb_out
=
fluid
.
layers
.
embedding
(
task_emb_out
=
fluid
.
embedding
(
task_ids
,
task_ids
,
size
=
[
self
.
_task_types
,
self
.
_emb_size
],
size
=
[
self
.
_task_types
,
self
.
_emb_size
],
dtype
=
self
.
_emb_dtype
,
dtype
=
self
.
_emb_dtype
,
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录