Merge pull request #9548 from panyx0718/group_nccl_all_reduce
Group nccl all reduce and improve performance (~14% for 4 device resnext)
Showing
想要评论请 注册 或 登录
Group nccl all reduce and improve performance (~14% for 4 device resnext)