提交 637018cb 编写于 作者: M mindspore-ci-bot 提交者: Gitee

!4308 fix resnet_gpu distribute init

Merge pull request !4308 from yuchaojie/fix_resnet_gpu_distribute_init
......@@ -81,11 +81,11 @@ if __name__ == '__main__':
init()
# GPU target
else:
init("nccl")
context.set_auto_parallel_context(device_num=get_group_size(), parallel_mode=ParallelMode.DATA_PARALLEL,
mirror_mean=True)
if args_opt.net == "resnet50":
auto_parallel_context().set_all_reduce_fusion_split_indices([85, 160])
init("nccl")
ckpt_save_dir = config.save_checkpoint_path + "ckpt_" + str(get_rank()) + "/"
# create dataset
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册