* OneDNN hardswish integration (#30211)

* keep only conv + hardswish in this PR
Co-authored-by: Njakpiase <62569058+jakpiase@users.noreply.github.com>

* add deprecated for softmax_with_cross_entropy (#31722)

* add deprecated for softmax_with_cross_entropy, test=develop

* test for deprecated in english doc, test=develop

* test deprecated for softmax_with_cross_entropy in english doc, test=develop

* fix readme and English doc for cross_entropy, test=develop

* rm test for softmax_with_cross_entropy deprecated, test=develop

* update readme for CrossEntropyLoss, test=develop

* fix readme format, test=develop

* fix readme format, test=develop

* fix readme format for cross_entropy, test=develop

* add softmax_switch and fix softlabel for cross_entropy, test=develop

* 1)recovery softmax_with_cross_entropy in fluid 2) change softmax_switch to use_softmax 3) add example for softlabel for cross_entropy, test=develop

* fix Example number for cross_entropy, test=develop

* fix code format, test=develop

* fix for CI-Coverage, test=develop

* fix for CI-Coverage, test=develop

* fix ci-coverage for Non-ASCII character '\xe2' in file, test=develop

* fix ci-coverage for Non-ASCII character '\xe2' in nn.layer.loss.py, test=develop

* update description for doc when use_softmax=Fasle, test=develop

* fix some docs and code example for cross_entropy, test=develop

* delete redundant description for soft_label parameter of cross_entropy, test=develop

* fix some comment for test_cross_entropy_loss.py, test=develop

* cherry-pick for add deprecated,test=develop

* Wojtuss/upgrade one dnn 2.0 (#30295)

* upgrade oneDNN version to 2.0 master branch

* - Added workarounds for new lib onednn change

* fix regex
Co-authored-by: NJacek Czaja <jacek.czaja@intel.com>

* update to oneDNN 2.2
Co-authored-by: NWojciech Uss <wojciech.uss@intel.com>
Co-authored-by: NJacek Czaja <jacek.czaja@intel.com>

This reverts commit 20e68a22.

* fix eval_if_exist_else_none bug

* fix typo

* fix typo

* fix test_op_num unittest

Cherry-pick double grad for clip

* fix entry

* fix distributed lookup table fuse case

* fix entry bug at first time

* move entry from paddle.fluid -> paddle.distributed

* fix ut with paddle.enable_static()
Co-authored-by: Nmalin10 <malin10@baidu.com>
Co-authored-by: Nmalin10 <malin10@baidu.com>

ATT, cherry-pick #31136

paddle.save/static.save指定pickle版本参数protocol(2<= pickle_protocol <=4)，默认pickle_protocol=2。
原始PR：#31044

Cherry-pick of #31051 and #31082

* A fix for oneDNN matmul kernel. Fixes issue #30309 (#30723)

* A fix for #30309 with oneDNN 1.6

* test=develop, save/load, shrink
Co-authored-by: NseiriosPlus <tangwei12@baidu.com>
Co-authored-by: N123malin <malin10@baidu.com>

* add  parameter in roi_align op

* fix compatibility of ops

* fix op test & cpu kernel

* fix JaccardOverlap in nms

* fix dataloader collate return list mix tensor and numpy array. test=develop

* remove numpy array check in single-process dataloader. test=develop

* Add Support for Tuple in for Loop (#30998)

Dy2stat didn't support tuple as iteration variable in the past. This PR added there main cases:

       1). Non-enumerate case: for var1, var2 in var|var.numpy() will be re-written as:
          for FOR_ITER_TUPLE_PREFIX_x in var | var.numpy():
            var1 = FOR_ITER_TUPLE_PREFIX_x[0]
            var2 = FOR_ITER_TUPLE_PREFIX_x[1]
        2). Enumerate out tuple case: for t in enumerate(var|var.numpy) will be rewritten as:
          for FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x in enumerate(var|var.numpy):
            t = (FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x)
        3). Enumerate inner tuple case: for i, (var1, (var2, va3)) in enumerate(var|var.numpy()) will
        be re-written as:
          for i, FOR_ITER_TUPLE_PREFIX_x in var | var.numpy():
            var1 = FOR_ITER_TUPLE_PREFIX_x[0]
            var2 = FOR_ITER_TUPLE_PREFIX_x[1][0]
            var3 = FOR_ITER_TUPLE_PREFIX_x[1][1]

* Refine fake_interface Error Message (#30981)

Refine fake_interface Error Message

Cherry-pick：Split unittest(#30727) to solve the problem of 'test_static_save_load' timeout.(#30727) (#30916)

单测test_static_save_load耗时较长，将主要耗时部分单独拆分出来，以免增加其他单测对其造成影响。
原始PR：#30727

cherry-pick #29998
* Polish and Optimize the print/repr message of all layer
* fix some code format

make abs support complex types

cherry-pick:
#30375
#30637

Co-authored-by: Ntianshuo78520a <707759223@qq.com>

* upgrade gather_tree to core.ops (#30697)

* upgrade gather_tree to core.ops

* update gather_tree unittests

* update gather_tree doc (#30693)

* update gather_tree doc, test=document_fix

* update sample code, test=document_fix

* remove tensor type, test=document_fix

* Add cache for Transformer encoder.

* Bug fixed.

* add unittests for transformer encoder.

* Add tf32 support for A100 tensor core acceleration for cuBLAS (#28732)

* Fixed an error

* Fixed an error

* Fix the bug in fleet amp_init.

* Fix the amp_init unit test.

This PR is cherry-picked from PR: #29192
Function: Added TF32 switch for cuDNN. Turned on as default, turned off when users set the switch as False

[Dy2static]Fix paddle prefix in is_paddle_api (#30569)
cherry-pick #30569

* add fleet amp.init()

* add unittest for fleet_amp_init

原始PR：#30485，#30507

[cherry-pick] support layer_norm fp16 in dygraph amp (#30430)

完善static.load的var_list参数。
当加载的是多个小文件时，Tensor列表可以是所有加载文件中Tensor的子集。
原始PR：#30457

cherry-pick #30536

* add 2.0 API: device_guard