paddle任务在gpu集群上多卡执行,报an illegal memory access was encountered
Created by: JayEworld
Pass 0, Batch 41, Cost 50.020385, {'__auc_evaluator_0__': 0.5005420446395874, 'classification_error_evaluator': 0.7870000004768372}
F0727 19:42:26.472332 5626 hl_cuda_device.cc:565] Check failed: cudaSuccess == cudaStat (0 vs. 77) Cuda Error: an illegal memory access was encountered
*** Check failure stack trace: ***
F0727 19:42:26.472338 5639 hl_cuda_device.cc:565] Check failed: cudaSuccess == cudaStat (0 vs. 77) Cuda Error: an illegal memory access was encounteredF0727 19:42:26.472342 5641 hl_cuda_device.cc:565] Check failed: cudaSuccess == cudaStat (0 vs. 77) Cuda Error: an illegal memory access was encounteredF0727 19:42:26.472340 5631 hl_cuda_device.cc:565] Check failed: cudaSuccess == cudaStat (0 vs. 77) Cuda Error: an illegal memory access was encountered
*** Check failure stack trace: ***