* Eliminate numerical differences of LayerNorm; fix LayerNorm Nan Bug while large data input

* fix bug while large shape of data input

* add unit8 for concat (#32850)

* add bool type for tril api (#33402)

Support diff dataset tensor place in single process dataloader

cherry-pick of #33470

使用op benchmark时发现，当输入数据量小于某个值时，python 端 log_softmax 接口的输入值经过计算过后 会被改变为nan。输出正常。

cherry-pick自 #32937

* fix conv2d_transpose trt bugs (#33242)

* fix jetson arch when compiling with single arch (#33269)

* Fix two english api documents, transpose and strided_slice

* OP:strided_slice_op supports bool type inputs

* fix compare op in for in the cuda device

* fix the paddle compare op for the broadcast

* fix precision of mp

* fix bug of seed

* fix dp

* print group

* BugFix with ParseInputDataType from LodTensorArray

* BugFix with ParseInputDataType from LodTensorArray

Change Paddle CI-Cverage Python3.8 Cherry-pick 32515

cherry-pick of #32972

* cherrypick for #32640 :add profile and fix dataset hang in heterps;test=develop

* cherrypick for #32640 :add profile and fix dataset hang in heterps;test=develop

* cherrypick for #32640 :add profile and fix dataset hang in heterps;test=develop

fix error log for reducer

fix doc

fix bug of utest

fix spawn

fix converage

* implement MHA order same as training

* fix fp16 compile issue on old architecture
Co-authored-by: Nzlsh80826 <rewang@nvidia.com>

* fix compile error on jetson platform

* remove unused head file

* rm decode_jpeg op on jetson platform

 [CHERRY-PICK2.1]Remove paddle_custom_op dynamic libraries, and link to FLUID_CORE on windows (#32583) (#32769)

* Remove paddle_custom_op dynamic libraries, change link to FLUID_CORE on windows, and check copy_to

* fix CI

修复了py_layer_op由于没有析构PyLayerContext造成内存(显存)泄露的问题。

原始pr：#32707

* clear 'BasicEngine' when an exception occurs in the backward. (#32546)

* clear 'BasicEngine' when an exception occurs in the backward.

* deal with conflict.

* deal with conflict.

* forward return any type. (#32661)

* base changes for fix

* minor change

* fix for bwd kernel

* removed unnecessary import

* implemented reviewers suggestions

* CI fix

cherry-pick:change softmax_with_cross_entropy_op's parameter name from softmax_switch to use_softmax (#32750)

* change parameter name from softmax_switch to use_softmax, test=develop

* cherry-pick:change parameter name from softmax_switch to use_softmax, test=develop

cherry-pick #32561