提交 5f343e3e 编写于 作者: Y Yang Yang

Merge remote-tracking branch 'pr/8411' into backward_on_parallel_do

...@@ -89,6 +89,7 @@ TEST(NCCL, all_reduce) { ...@@ -89,6 +89,7 @@ TEST(NCCL, all_reduce) {
VLOG(1) << "Invoking ncclAllReduce"; VLOG(1) << "Invoking ncclAllReduce";
dynload::ncclGroupStart();
for (int i = 0; i < dev_count; ++i) { for (int i = 0; i < dev_count; ++i) {
VLOG(1) << "Invoking ncclAllReduce with device " << i; VLOG(1) << "Invoking ncclAllReduce with device " << i;
SetDeviceId(i); SetDeviceId(i);
...@@ -97,6 +98,7 @@ TEST(NCCL, all_reduce) { ...@@ -97,6 +98,7 @@ TEST(NCCL, all_reduce) {
ncclSum, comms[i], data[i]->dev_ctx.stream())); ncclSum, comms[i], data[i]->dev_ctx.stream()));
VLOG(1) << "Invoked ncclAllReduce for device " << i; VLOG(1) << "Invoked ncclAllReduce for device " << i;
} }
dynload::ncclGroupEnd();
VLOG(1) << "Invoked ncclAllReduce"; VLOG(1) << "Invoked ncclAllReduce";
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册