Created by: tensor-tang

This is an issue started here https://github.com/PaddlePaddle/Paddle/issues/11185#issuecomment-394605215. @ChinaLiuhao

It would randomly aborted when use multi-threads.