Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
wmsofts
Paddle
提交
ecb8c184
P
Paddle
项目概览
wmsofts
/
Paddle
与 Fork 源项目一致
Fork自
PaddlePaddle / Paddle
通知
1
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
Paddle
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
未验证
提交
ecb8c184
编写于
12月 29, 2021
作者:
S
ShenLiang
提交者:
GitHub
12月 29, 2021
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[BugFix]Fix bug in obtaining parameters_buffers in layers (#38563)
* fix bug of dp in pfp16 * fix topo
上级
2fb1fc0d
变更
2
显示空白变更内容
内联
并排
Showing
2 changed file
with
15 addition
and
7 deletion
+15
-7
python/paddle/fluid/dygraph/layers.py
python/paddle/fluid/dygraph/layers.py
+14
-5
python/paddle/fluid/dygraph/parallel.py
python/paddle/fluid/dygraph/parallel.py
+1
-2
未找到文件。
python/paddle/fluid/dygraph/layers.py
浏览文件 @
ecb8c184
...
@@ -1271,7 +1271,7 @@ class Layer(object):
...
@@ -1271,7 +1271,7 @@ class Layer(object):
self
.
_state_dict_hooks
[
hook_remove_helper
.
_hook_id
]
=
hook
self
.
_state_dict_hooks
[
hook_remove_helper
.
_hook_id
]
=
hook
return
hook_remove_helper
return
hook_remove_helper
def
_
state_dict_impl
(
self
,
def
_
obtain_parameters_buffers
(
self
,
destination
=
None
,
destination
=
None
,
include_sublayers
=
True
,
include_sublayers
=
True
,
structured_name_prefix
=
""
,
structured_name_prefix
=
""
,
...
@@ -1308,7 +1308,16 @@ class Layer(object):
...
@@ -1308,7 +1308,16 @@ class Layer(object):
structured_name_prefix
+
layer_name
+
"."
,
structured_name_prefix
+
layer_name
+
"."
,
include_non_persistable_buffer
))
include_non_persistable_buffer
))
destination
=
destination_temp
destination
=
destination_temp
return
destination
def
_state_dict_impl
(
self
,
destination
=
None
,
include_sublayers
=
True
,
structured_name_prefix
=
""
,
include_non_persistable_buffer
=
False
):
destination
=
self
.
_obtain_parameters_buffers
(
destination
,
include_sublayers
,
structured_name_prefix
,
include_non_persistable_buffer
)
for
state_dict_hook
in
self
.
_state_dict_hooks
.
values
():
for
state_dict_hook
in
self
.
_state_dict_hooks
.
values
():
hook_result
=
state_dict_hook
(
destination
)
hook_result
=
state_dict_hook
(
destination
)
if
hook_result
is
not
None
:
if
hook_result
is
not
None
:
...
...
python/paddle/fluid/dygraph/parallel.py
浏览文件 @
ecb8c184
...
@@ -356,8 +356,7 @@ def sync_params_buffers(model,
...
@@ -356,8 +356,7 @@ def sync_params_buffers(model,
src_rank
=
0
,
src_rank
=
0
,
is_model_parallel
=
False
):
is_model_parallel
=
False
):
model_vars
=
[]
model_vars
=
[]
params_buffers
=
model
.
parameters
()
+
model
.
buffers
()
for
_
,
param
in
model
.
_obtain_parameters_buffers
().
items
():
for
param
in
params_buffers
:
if
not
isinstance
(
param
,
core
.
VarBase
):
if
not
isinstance
(
param
,
core
.
VarBase
):
raise
TypeError
(
"The data type of '%s' must be Varbase"
%
raise
TypeError
(
"The data type of '%s' must be Varbase"
%
param
.
name
)
param
.
name
)
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录