* support fp16 dtype

* [NPU] fix depthwise_conv2d_grad, test=develop

* remove debug files, test=develop

* fix instance norm index error

* add unittest

* update

* fix

This reverts commit ae93d9c2.

* fix warning error , test=document_fix

* fix warning error , test=document_fix

* fix warning error , test=document_fix

* fix warning error , test=document_fix

* fix warning error , test=document_fix

* fix warning error , test=document_fix

* fix warning error , test=document_fix

This PR supports gradient clip (ClipGradByGlobalNorm) when training with AMP(auto mixed precision).

* fix scatter_nd_add doc, test=document_fix

* update
test=document_fix

* add conv op check for illegal input or attributes

* add AsExtra in data_norm op

* pass data_layout from python to data_norm op

* fix data_layout in data_norm op
Co-authored-by: Nroot <root@bjyz-sys-gpu-kongming9.bjyz.baidu.com>

* transfer the static.accurcay to v2 api

* remove the unused code

* fix bug:When axes in paddle.sile is a tuple, an error occurs.

* polish code.

* Support append method and initialized value for List in ControlFlow

* polish error msg and en doc

* fix code style

* polish the error message of paddle.slice.

* polish code.

* Enable BF16 for creating global tensor and reduce_mean.

* Functional test with small model.

* dygraph support more ctc grad scale

* scale for 1.x

* fix unitest

* fix unitest

* format code

* fix unittest

* fix log info

* unittest cov

* fix format;notest,test=cpu,coverage

* skip ctc_loss egs;test=cpu

* warpctc grad cov;test=coverage

* add dygraph test;test=coverage

* format;test=cpu,coverage

* format;test=cpu

* add api compat;test=cpu

* add cpu test

* rename

* rename

* fix

* fix test

* format

* eigen cpu

* eigen gpu grad pass

* cuda gpu pass

* format

* fix ci

* Fix typos in english docs for diag and diagflat.

* fix dice_loss bug

* fix paddle.optimizer test=document_fix

* fix paddle.optimizer test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

* fix bugs in paddle.nn.functional document test=document_fix

Revert "Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)" (#34384)

This reverts commit 577fdde5.

Revert "[Dy2Stat] Refactor ExecutorCache logic and pre-support BuildStrategy for pass (#34181)" (#34348)

This reverts commit 609f8225.

* logical ops support int8, int16, int32, int64, float, double

* update docs of logical ops

* fix npu and xpu logical ops

* fix npu and xpu logical ops

* fix bug in xpu logical op code

* update test_logical_op_npu and test_logical_op_xpu

* correct error type

* modify into program_id

* fix cache_info declare problem

* fix python int to C long problem

* modify point to reference

* add ENVS

* fix crop_tensor op doc

* update code example test=document_fix

* update readme test=document_fix

* update while loop docs test=document_fix

* cache core.ops, test=develop

* refine, test=develop

As the title, add Python helper function to get block Inputs/Outputs. This function is helpful to distributed computing for sharding.

* opt dygraph python code, test=develop

* refine, test=develop

* opt dygraph python API, test=develop

* Fix unbind bug in manipulation.py

* add returns for beamsearchdecoder doc, test=document_fix

As the title