Created by: typhoonzero

Fix #11128 (closed)

work at https://github.com/PaddlePaddle/Paddle/pull/11132 may cause some unitest hung. will continue that work after this quick fix.