Created by: kolinwei

[22:53:26]W: [Step 3/3] File "train.py", line 170, in [22:53:26]W: [Step 3/3] train() [22:53:26]W: [Step 3/3] C++ Callstacks: [22:53:26]W: [Step 3/3] invalid argument at [/workspace/paddle/fluid/operators/sync_batch_norm_op.cu:183] [22:53:26]W: [Step 3/3] PaddlePaddle Call Stacks: [22:53:26]W: [Step 3/3] 0 0x7f94ac7b1d50p void paddle::platform::EnforceNotMet::Init<char const*>(char const*, char const*, int) + 352 [22:53:26]W: [Step 3/3] 1 0x7f94ac7b20c9p paddle::platform::EnforceNotMet::EnforceNotMet(std::exception_ptr::exception_ptr, char const*, int) + 137 [22:53:26]W: [Step 3/3] 2 0x7f94aca0ecd0p paddle::operators::SyncBatchNormKernel<paddle::platform::CUDADeviceContext, float>::Compute(paddle::framework::ExecutionContext const&) const + 5328 [22:53:26]W: [Step 3/3] 3 0x7f94aca0ef43p ZNSt17_Function_handlerIFvRKN6paddle9framework16ExecutionContextEEZNKS1_24OpKernelRegistrarFunctorINS0_8platform9CUDAPlaceELb0ELm0EINS0_9operators19SyncBatchNormKernelINS7_17CUDADeviceContextEfEENSA_ISB_dEEEEclEPKcSG_iEUlS4_E_E9_M_invokeERKSt9_Any_dataS4 + 35 [22:53:26]W: [Step 3/3] 4 0x7f94ae701027p paddle::framework::OperatorWithKernel::RunImpl(paddle::framework::Scope const&, boost::variant<paddle::platform::CUDAPlace, paddle::platform::CPUPlace, paddle::platform::CUDAPinnedPlace, boost::detail::variant::void, boost::detail::variant::void, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_> const&, paddle::framework::RuntimeContext*) const + 375 [22:53:26]W: [Step 3/3] 5 0x7f94ae701401p paddle::framework::OperatorWithKernel::RunImpl(paddle::framework::Scope const&, boost::variant<paddle::platform::CUDAPlace, paddle::platform::CPUPlace, paddle::platform::CUDAPinnedPlace, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_> const&) const + 529 [22:53:26]W: [Step 3/3] 6 0x7f94ae6fe9fcp paddle::framework::OperatorBase::Run(paddle::framework::Scope const&, boost::variant<paddle::platform::CUDAPlace, paddle::platform::CPUPlace, paddle::platform::CUDAPinnedPlace, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_> const&) + 332 [22:53:26]W: [Step 3/3] 7 0x7f94ae4fbc5ap paddle::framework::details::ComputationOpHandle::RunImpl() + 250