* [CustomOp] Add Modeling with Custom op unittest (#31218)

* add unittest for static/dygraph/dy2stat

* add PE unittet

* remove usless code

* add unittest in CMakeList.txt

* [CustomOp] Split build op marco & polish details (#31229)

* split build op marco & polish details

* revert register api del

* fix other unittest

* [CustomOP]Support Incremental compilation and Add Version management (#31228)

* Support Incremental compilation and Add Version management

* replace hash with hashlib

* fix test_op_num unittest

* Revert "fix test_op_num unittest"

This reverts commit 2f78de976e1d7ca60915b2310717b38a32ae204a.
Co-authored-by: NChen Weihang <chenweihang@baidu.com>

[Cherry-pick] The Second part of new custom op extension in 2.0.1

* fix code style in nn/functional/loss.py, test=develop

* fix code style in nn/functional/loss.py, test=develop

* Use correct master weights in AdamW.

* Just modify the master weight.

* Update for CI Coverage.

* fix a bug of Sequential::__getitem__, test=develop

test=document_fix

Cherry-pick double grad for clip

* fix entry

* fix distributed lookup table fuse case

* fix entry bug at first time

* move entry from paddle.fluid -> paddle.distributed

* fix ut with paddle.enable_static()
Co-authored-by: Nmalin10 <malin10@baidu.com>
Co-authored-by: Nmalin10 <malin10@baidu.com>

ATT, cherry-pick #31136

[CustomOp] New custom operator extension mechanism in 2.0.1

Cherry-pick New custom operator basic implementation related PRs

paddle.save/static.save指定pickle版本参数protocol(2<= pickle_protocol <=4)，默认pickle_protocol=2。
原始PR：#31044

Cherry-pick of #31051 and #31082

* A fix for oneDNN matmul kernel. Fixes issue #30309 (#30723)

* A fix for #30309 with oneDNN 1.6

* test=develop, save/load, shrink
Co-authored-by: NseiriosPlus <tangwei12@baidu.com>
Co-authored-by: N123malin <malin10@baidu.com>

test=document_fix

* add  parameter in roi_align op

* fix compatibility of ops

* fix op test & cpu kernel

* fix JaccardOverlap in nms

* fix dataloader collate return list mix tensor and numpy array. test=develop

* remove numpy array check in single-process dataloader. test=develop

* Add Support for Tuple in for Loop (#30998)

Dy2stat didn't support tuple as iteration variable in the past. This PR added there main cases:

       1). Non-enumerate case: for var1, var2 in var|var.numpy() will be re-written as:
          for FOR_ITER_TUPLE_PREFIX_x in var | var.numpy():
            var1 = FOR_ITER_TUPLE_PREFIX_x[0]
            var2 = FOR_ITER_TUPLE_PREFIX_x[1]
        2). Enumerate out tuple case: for t in enumerate(var|var.numpy) will be rewritten as:
          for FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x in enumerate(var|var.numpy):
            t = (FOR_ITER_TUPLE_INDEX_PREFIX_x, FOR_ITER_TUPLE_PREFIX_x)
        3). Enumerate inner tuple case: for i, (var1, (var2, va3)) in enumerate(var|var.numpy()) will
        be re-written as:
          for i, FOR_ITER_TUPLE_PREFIX_x in var | var.numpy():
            var1 = FOR_ITER_TUPLE_PREFIX_x[0]
            var2 = FOR_ITER_TUPLE_PREFIX_x[1][0]
            var3 = FOR_ITER_TUPLE_PREFIX_x[1][1]

* Refine fake_interface Error Message (#30981)

Refine fake_interface Error Message

Cherry-pick：Split unittest(#30727) to solve the problem of 'test_static_save_load' timeout.(#30727) (#30916)

单测test_static_save_load耗时较长，将主要耗时部分单独拆分出来，以免增加其他单测对其造成影响。
原始PR：#30727

cherry-pick #29998
* Polish and Optimize the print/repr message of all layer
* fix some code format

make abs support complex types

cherry-pick:
#30375
#30637

Co-authored-by: Ntianshuo78520a <707759223@qq.com>

* add readme in whl package

* fix chinese

* fix encoding

* del test

* upgrade gather_tree to core.ops (#30697)

* upgrade gather_tree to core.ops

* update gather_tree unittests

* update gather_tree doc (#30693)

* update gather_tree doc, test=document_fix

* update sample code, test=document_fix

* remove tensor type, test=document_fix

* Add cache for Transformer encoder.

* Bug fixed.

* add unittests for transformer encoder.

* Alias from  paddle.fluid.layers.auc to paddle.static.auc (#30206)

* add alias from  fluid.layers.auc to static.auc

* Update __init__.py

* add auc into all list

* alias acc, expose to users

* add auc into 'all' list (#30310)

* add auc into 'all' list

* alias acc, expose to users

* update sample code

* fix paddle.static.acc and auc sample code bug, test=document_fix

* Add tf32 support for A100 tensor core acceleration for cuBLAS (#28732)

* Fixed an error

* Fixed an error

动态图中Conv2D保存成预测模型时，对应的Op可能是conv2d，也可能是depthwise_conv2d，但目前的save_quantized_model接口并未考虑depthwise_conv2d情况，可能会致使out_scale的值保存错误，该PR主要是修复这个问题。

* Fix the bug in fleet amp_init.

* Fix the amp_init unit test.

This PR is cherry-picked from PR: #29192
Function: Added TF32 switch for cuDNN. Turned on as default, turned off when users set the switch as False