On the basis of the above, using FP16 half-precision can further improve the training speed, just add fields in the start training command `AMP.use_pure_fp16=True`:
On the basis of the above, using FP16 half-precision can further improve the training speed, you can refer to the following command.