Created by: seiriosPlus

The detail message is:

E0331 14:26:21.291831   614 listen_and_serv_op.cc:68] run sub program error enforce param_dim == ctx->GetInputDim("Grad") failed, 512, 1, 3, 3 != 0
Param and Grad input of MomentumOp should have the same dimension. at [/paddle/paddle/fluid/operators/momentum_op.cc:43]
PaddlePaddle Call Stacks:
0       0x7f142ad101dcp paddle::platform::EnforceNotMet::EnforceNotMet(std::__exception_ptr::exception_ptr, char const*, int) + 572
1       0x7f142b2fc4bbp paddle::operators::MomentumOp::InferShape(paddle::framework::InferShapeContext*) const + 1387
2       0x7f142b52b928p paddle::framework::OperatorWithKernel::RunImpl(paddle::framework::Scope const&, boost::variant<paddle::platform::CUDAPlace, paddle::platform::CPUPlace, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_> const&) const + 104
3       0x7f142b528418p paddle::framework::OperatorBase::Run(paddle::framework::Scope const&, boost::variant<paddle::platform::CUDAPlace, paddle::platform::CPUPlace, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_, boost::detail::variant::void_> const&) + 72
4       0x7f142adc4076p paddle::framework::Executor::RunPreparedContext(paddle::framework::ExecutorPrepareContext*, paddle::framework::Scope*, bool, bool) + 1750
5       0x7f142adc4f87p paddle::framework::Executor::Run(paddle::framework::ProgramDesc const&, paddle::framework::Scope*, int, bool, bool) + 103
6       0x7f142b489143p
7       0x7f142b39a31ep std::__future_base::_State_baseV2::_M_do_set(std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>*, bool*) + 46
8       0x7f1476ee2a99p
9       0x7f142b488a27p
10      0x7f142b541934p paddle::framework::ThreadPool::TaskLoop() + 1012
11      0x7f146c043c80p
12      0x7f1476edb6bap
13      0x7f1476c1141dp clone + 109

ENV: Docker PaddlePaddle: gpu-lastest model: https://github.com/PaddlePaddle/models/blob/develop/fluid/image_classification/mobilenet.py Fluid config: 1 pserver, 1 trainer