Paddle 集群训练报错
Created by: bigshipbig
paddle_trainer.ERROR
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
F0821 03:29:07.149883 5791 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytes
F0821 03:29:07.150223 5790 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.150602 5794 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.150923 5793 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.151538 5774 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.151649 5777 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.157371 5772 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.157722 5775 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.157735 5778 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.157778 5780 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.165516 5800 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.165663 5787 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.165773 5781 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.165848 5797 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.165885 5784 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.166020 5771 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.166051 5788 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.166059 5796 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.166127 F5783 821 MemoryHan166134: 5786 52] ryHandle.cpp:52Check failed: size != 0 allocate 0 bytesCheck failed: size != 0 allocate 0 bytesF0821 03:29:07.166229 5770 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytesF0821 03:29:07.166235 5799 MemoryHandle.cpp:52] Check failed: size != 0 allocate 0 bytes