* add swish yaml and final state api

* skip mkldnn test

* fix grad mkldnn test

* afs wrapper

* format

* format

* macro

* add dist erfinv gumbel softmax

* fix test gumbel softmax op bug

* try to fix gumbel softmax error

* add label smooth backlist

* add yaml

* perfect converage

* modify matrix_rank

* add matrix_rank shape

* add matrix_rank shape

* Add yaml for matrix_rank OP

* Add UT
Co-authored-by: Nzhoujianqian <15205085056@163.com>

* add unbind yaml

* fix unittest

* Sitch some dy2st UT to eager mode

* Fix test_lstm and remove test_transformer

* Run test_resnet_v2 in old dy mode

* Profile Executors

* update

* fix ut

* fix names

* update

* update

* add gelu pythonapi and unittest

* fix prelu

* add Output(Step) to distributed fused lamb op

* add _set_step

* add one_hot gpu hint

* move allow_out_of_range judgement

* delete useless unittest

* no

* maintain old profiler

* fix old dygraph record event

* ignore some failed test for KL2
*test=kunlun

* minor
*test=kunlun

* minor
*test=kunlun

* add rewrite pattern form paddle op tp trt op

* infrt-trt run resnet50.
Co-authored-by: weishengying <1343838695@qq.com>

* change inference demo_test build method to ninja to choose visual studio version automaticly

* notest;test=windows_ci_inference

* set cuda of demo_ci by arg,fix bug of ninja compile,test=document_fix;test=windows_ci;test=windows_ci_inference

* fix bug;test=document_fix;test=windows_ci;test=windows_ci_inference

* fix bug;test=document_fix;test=windows_ci_inference"

* set lib_path according to generator

* polish truncated normal kernel

* add yaml

* add truncated normal kernel and add yaml

* polish unittests and yaml

* import dygraph mehtod

* momentum support l2decay for xpu. test=kunlun

* fix include file. test=kunlun

* fix cmake for device_worker. test=kunlun

* modify infer gpu memory strategy

* modify infer gpu memory strategy

* Add GPU memory usage information in the print of profiler.

* Add ifdef.

* support final_state in multiprocess

* fix no place.device

* set device_id in eager_gen