* bert benchmark fleet support pure_fp16

* fix use_pure_fp16

fix the pure fp16 of argument (#5236)

* refine transformer cpu

* delete run_pretrain.sh

* support AMP training

* change the dir name

* add static step final save

* refine doc

* alter method name

* add pure fp16 training.

* Add lookup_table in custom_black_list during the pure fp16 training.

* add benchmark readme

* add predict for static

* update doc for fleet api

* typo

* add dygraph amp support for transformer

* according params use_amp to decide use dygraph amp

* add fleet, test=develop

* support pad seq and bsz multi

* alter vocab size

* alter md5sum

* root for reader

nlp bert benchmark add gradient merge

* add static predict

* rm position_encoding_init

* fix static predict

* add the xpu support the the paddlenlp

* add the support xpu for the ernie and bert
Co-authored-by: Nwawltor <fanzeyang0904@hotmail.com>

change the format for the bert benchmark (#5160)

* fix incorrect usage of data loader

* refine code

* remove unused code

* refine code

add the suport the log format for the benchmark

* add pad factor to pad vocab

* shuffle batch

* update reader

* update benchmark

* fix hung

* add shuffle batch

* update

* reader_seed to shuffle_seed

* seed for shuffle batch

* add the benchmark glue for some task

* fix the qnil result for the bert benchmark

* change the from the logger to framework logger

* fix translation dataset and simplify transformer reader

Co-authored-by: Nwawltor <fanzeyang0904@hotmail.com>

* update the readme for the benchmark

* udpate README file for the bert benchmark

* uddate the readme format for the benchmark bert
Co-authored-by: Nwawltor <fanzeyang0904@hotmail.com>
Co-authored-by: Nfangzeyang <fangzeyang@baidu.com>

* add custom op gelu

* refine run_pretrain

* add the support of amp for the fleet train
* remove the attribute for the amp

Co-authored-by: Nfangzeyang <fangzeyang@baidu.com>