cherry-pick #31068

* add get_cublas_handle() api

* update format

* add unittests

* alter function name

Cherry-pick double grad for clip

* fix entry

* fix distributed lookup table fuse case

* fix entry bug at first time

* move entry from paddle.fluid -> paddle.distributed

* fix ut with paddle.enable_static()
Co-authored-by: Nmalin10 <malin10@baidu.com>
Co-authored-by: Nmalin10 <malin10@baidu.com>

* added support for fake_quantize_dequantize_abs_max op in quantization inference pass

* remove const_cast to pass ci

* remove compare operator to pass ci-coverage

* added detailed error message for unregistered tensorrt_subgrah_pass

[CustomOp] New custom operator extension mechanism in 2.0.1

Cherry-pick New custom operator basic implementation related PRs

[BUG FIX] Fix softmax cross entropy overflow problem.

* [Kunlun] Add condition_variable and notify() in BindThreadedSSAGraphExecutor (#30586)

* [Kunlun] fix dead lock for exec_op_count_ (#30718)

* Fix the problem that the number of ops executed by xpu is wrong (#30961)
Co-authored-by: Nliuyuhui <liuyuhui@baidu.com>

ATT, cherry pick of #31132

* A fix for oneDNN matmul kernel. Fixes issue #30309 (#30723)

* A fix for #30309 with oneDNN 1.6

* test=develop, save/load, shrink
Co-authored-by: NseiriosPlus <tangwei12@baidu.com>
Co-authored-by: N123malin <malin10@baidu.com>

* add  parameter in roi_align op

* fix compatibility of ops

* fix op test & cpu kernel

* fix JaccardOverlap in nms

* bug fix of xpu lite engine, test=develop

* xpu zero copy tensor, test=develop

* revert paddle/fluid/inference/tests/api/CMakeLists.txt

* support if else control

* fix conflict

* 【Paddle.Fleet】Fix brpc get hostname (#30703)

* fix Brpc get hostname

* fix int64 bug (#30780)

fix push sparse int64 bug

cherry-pick #29998
* Polish and Optimize the print/repr message of all layer
* fix some code format

make abs support complex types

cherry-pick:
#30375
#30637

Co-authored-by: Ntianshuo78520a <707759223@qq.com>

* fixed compilation error on gcc 4.8.x due to the usage of isfinite (#30733)

* modified conv+bn fuse pass to fix wrong mask in mask rcnn (#30704)

* add dla

* add python api
Co-authored-by: Nshangzhizhou <root@szth-rp-fanyi-opera49.szth.baidu.com>
Co-authored-by: Nshangzhizhou <root@szth-rp-fanyi-opera49.szth.baidu.com>

Co-authored-by: NJacek Czaja <jacek.czaja@intel.com>

* Add tf32 support for A100 tensor core acceleration for cuBLAS (#28732)

* Fixed an error

* Fixed an error

This PR is cherry-picked from PR: #29192
Function: Added TF32 switch for cuDNN. Turned on as default, turned off when users set the switch as False

Cherry pick PR #30520 .
Fix error message of Inplace strategy.

[cherry-pick] support layer_norm fp16 in dygraph amp (#30430)

cherry-pick #30553
fix bug of multicard grad ncclAllReduce, the gradient accumulater of parameters should be keep order, otherwsie, it will influence multicard ncclAllReduce of grad.

cherry-pick #30536

Fix the compiling error of update_loss_scaling when using cuda9.