* Using the maximum workspace_size of all alogirhms to limit the workspace size in exhaustive search mode.

* Use the system cudaMalloc and cudaFree to allocate workspace during searching.

* Enable switch of two kind of workspace setting methods.
Co-authored-by: NLiu Yiqun <liuyiqun01@baidu.com>

* fix_ci_problem3

* support windows no default error

* fix bug that no thread is waked up when adding task to threadpool

* fix typo

fix group_norm vectorized address misalignment

* modify unittest of lstm forward, *test=kunlun

* modify unittest of lstm forward, *test=kunlun

* [Eager]Fix segment_pool/allclose/isclose/scale API bug

* fix kernel register problem

* [ROCm] fix dcu error in device event base, test=develop

* fix, test=develop

* ad conj flip yaml

* add flip conj pixel shuffle

* afs wrapper

* format

* format

* macro

* add yaml

* perfect converage

* modify matrix_rank

* add matrix_rank shape

* add matrix_rank shape

* Add yaml for matrix_rank OP

* Add UT
Co-authored-by: Nzhoujianqian <15205085056@163.com>

* add unbind yaml

* fix unittest

* Profile Executors

* update

* fix ut

* fix names

* update

* update

* add Output(Step) to distributed fused lamb op

* add _set_step

* add one_hot gpu hint

* move allow_out_of_range judgement

* delete useless unittest

* no

* maintain old profiler

* fix old dygraph record event

* ignore some failed test for KL2
*test=kunlun

* minor
*test=kunlun

* minor
*test=kunlun

* add rewrite pattern form paddle op tp trt op

* infrt-trt run resnet50.
Co-authored-by: weishengying <1343838695@qq.com>

* change inference demo_test build method to ninja to choose visual studio version automaticly

* notest;test=windows_ci_inference

* set cuda of demo_ci by arg,fix bug of ninja compile,test=document_fix;test=windows_ci;test=windows_ci_inference

* fix bug;test=document_fix;test=windows_ci;test=windows_ci_inference

* fix bug;test=document_fix;test=windows_ci_inference"

* set lib_path according to generator

* polish truncated normal kernel

* add yaml

* add truncated normal kernel and add yaml

* polish unittests and yaml

* import dygraph mehtod

* momentum support l2decay for xpu. test=kunlun

* fix include file. test=kunlun

* fix cmake for device_worker. test=kunlun

* modify infer gpu memory strategy

* modify infer gpu memory strategy

* Add GPU memory usage information in the print of profiler.

* Add ifdef.