Fork自 PaddlePaddle / Paddle
As nccl comm is not created by CUDADeviceContext, it should be destroyed by the creator as the best practice of RAII.
拖放文件到此处或点击上传