an inappropriate root number in nccl test
Created by: tonyyang-svail
We have kRoot
set to 5 at in NCCLTester.ncclBcastOp
.
However, this implies the machine to have at least 6 GPUs. If it is not the case, we will get an invalid argument error. invalid argument at [/paddle/paddle/operators/nccl_op.cu.cc:193]