未验证 提交 0d081357 编写于 作者: Y Yuang Liu 提交者: GitHub

change default value of sharding related env (#56835)

上级 51ba2a0f
......@@ -371,7 +371,7 @@ def fused_parameters(
:param scale_after_comm: if enable comm overlap, specify the location of grad scale
:return: param storage if fused, comm buffers is comm overlap
"""
g_shard_use_reduce = int(os.environ.get("FLAGS_shard_use_reduce", 0))
g_shard_use_reduce = int(os.environ.get("FLAGS_shard_use_reduce", 1))
act = (
HOOK_ACTION.ALL_REDUCE if not g_shard_use_reduce else HOOK_ACTION.REDUCE
)
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册