Created by: ccmeteorljh

https://github.com/PaddlePaddle/models/blob/19b3be8ff6feaab5476a93a6abecd2e3d3fed4fe/fluid/neural_machine_translation/transformer/train.py#L610 sync_mode=args.sync