未验证 提交 3b299997 编写于 作者: 郭叶军's avatar 郭叶军 提交者: GitHub

deepspeed/comm/comm.py: fix typo of warning message (#3636)

Co-authored-by: NMichael Wyatt <michaelwyatt@microsoft.com>
上级 e02b8d0b
......@@ -256,7 +256,7 @@ def reduce_scatter_fn(output_tensor,
else:
if get_rank() == 0:
utils.logger.warning_once("unable to find torch.distributed.reduce_scatter_tensor. will fall back to "
"torch.distributed.all_gather which will result in suboptimal performance. "
"torch.distributed.reduce_scatter which will result in suboptimal performance. "
"please consider upgrading your pytorch installation.")
input_tensor_lst = list(torch.chunk(tensor, cdb.get_world_size(group)))
return reduce_scatter(output_tensor,
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册