* fix sub sign reverse for mkldnn

* refactor code as comment

* remove useless

* unexpose audio ParameterError

* clean audio utils api

* use re replace judge by case

* simplify re

* [BugFix]Fix reduce_mean/min/sum/prod, cumsum grad_op infershape bug

* fix typo

* fix typo

uniform logger manager in FleetAPI.
hidde API under distributed/utils which users don't need.

* fix bugs of mp

* fix bugs of mp

* update

* update

* fix bug

* [Check]Enhance pooling output_size type check

* add unittest

* [JitLayer]Erase out vars to avoid data rewrittinig

* Fix code comments

Co-authored-by: Zhou Wei <1183042833@qq.com>

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fix gloo compile warning

* adapt for nn fl-ps

* flps del fake-init op

* add learning_rate_0 intializer op

This reverts commit a2b2af90.

* fix cast bug

* [XPU] update xdnn activations. (#46246)

* [XPU] update xpu cmake. test=kunlun

* Move ITensor construction for Weight (persistable variable) from OpConvert to TensorRTEngine.

* polish code comments

* polish data_device_transform.cc

* [Auto Parallel] Change the import way of Auto Parallel (#46115)

* fix strategy (#46256)

* [Auto Parallel] performance improvement for Sharding-DP hybrid parallelism (#46180)

* remove no need grad allreduce communication when sharding-dp

* remove no need grad allreduce communication when sharding-dp

* bugfix

* bugfix

* bugfix
Co-authored-by: NYulong Ao <aoyulong@baidu.com>
Co-authored-by: NJZ-LIANG <jianzhongliang10@gmail.com>

* [Eager] Fix ocr (#46124)

* fix linspace error in amp

* fix log

* fix amp error

* fix ocr error which caused by amp

* add more check

* rename dtype ns

* [Eager Bug fix]Fix Detection (#46147)

* fix linspace error in amp

* fix log

* fix amp error

* Revert "Simplify size op impl (#45808)"

This reverts commit c252b1de.

* fix_seg

* fix detection
Co-authored-by: NChen Weihang <sunny_cwh@163.com>
Co-authored-by: NChen Weihang <sunny_cwh@163.com>

* Fix bug of reduce_sum op. When input.numel() > INT32_MAX,
its result is wrong.

* Cherry-pick of PR 46045

* Fix bug of reduce_sum kp op.

* Fix bug of reduce_sum kp operator compilation.
If compilation device is XPU, eigen kernel should be ignored.

* Support matmul_v2 in Paddle-TensorRT converter.

* add config

* add config

* follow comments

* fix serial run

* Fix TransDataBackend Error when call unsqueeze using MKL Tensor

* Add UT

* Refine UT

cherry-pick : #46016, #46021, #45974

* [Sparse]Sparse add support gpu (#45974)

* [Sparse]Remove unused code (#46021)

* [Sparse] Add infer meta (#46016)

* fix linspace error in amp

* fix log

* fix amp error

* support cast op backward refuse forward and fix some bugs (#46173)

* support cast op backward refuse forward

* Fix the bug of high order unit test framework

* support sign op backward refuse forward (#46002)

* fix preln_residual_bias_fuse_pass bug in TNT_small model

* add scope cache & reuse

* add gc scope for end of each train step

* del scope reuse for jit

* refine code

* test

cherry-pick from #45826
LayoutAutotune 支持 inplace 类型的OP
 根据 Add eager layout autotune #45409 修改意见调整UseAutotune
将LayoutAutotune判断放到controller中，与AMP 判断保持一致

* fix static_check error when compile twice (#46140)

* [CI] fix static check in build_pr_dev (#46192)
Co-authored-by: Zhou Wei <1183042833@qq.com>

* fix wrong eigen header include

* fix complie bug

* fix nan_inf_utils_detail

* fix resource_manager

* fix conv_miopen_helper

[vision.ops.nms] Fix return order error and duplicate results with specific inputs (#46148) (#46193)

* fix return order error and duplicate results with specific inputs

* [cherry-pick] extend reduce_sum,reduce_sum,eq,ne,ge,abs,pow,etc higher order operators

* add reduce_mean,reduce_sum primitive ops
* add ne_p gt_p primitive operators
* add ge_p abs_p primitive oparators
* add cast primitive operators
* add pow,square prim2oirg rules
* add elementwise_div orig2prim rule

* [cherry-pick] add mean,sum,ge,gt,ne,abs,etc higher-order differentiation operators(#45888)

* add reduce_mean,reduce_sum primitive ops

* add ne_p gt_p primitive operators

* add ge_p abs_p primitive oparators