* add bf16 support and bf16/fp16 unittest for pool2d

* add include files

* dbg

* reformat

* reformat

* modify code according to review comment

* remove duplicate code

* remove dup code

* remove useless include

* dbg

* test, test=develop

* test, test=develop

* test, test=develop

* [DO NOT MERGE] adadelta lr support

* [DO NOT MERGE] gpu support

* [test] follow torch

* fix acc update order

* for ci

* [bug fix] update master para

* [bug fix] update test

* [bug fix] for ci test

* for ci

* fix xpu

* [adadelta fix] del fluid head file

* for ci

* del notes

* update save model

* update

* move python/paddle/fluid/tests/unittests/xpu to test/xpu

* update CMakeLists.txt

* remove xpu in fluid/tests/unittests/

* add path to op_test_xpu

* fix incorrect path

* update test script

* fix test_adadelta_op_xpu error

* [AMP OP&Test] support bf16 for batchnorm

* codestyle

* Update batch_norm_grad_kernel.cu

* Update batch_norm_kernel.cu

* fix codestyle

* fix

* fix

* fix

* fix

* fix

* Update batch_norm_kernel.cc

* delete [-Wno-error=terminate], test=develop

* remove GPUps[-Wterminate],test=develop

* remove some -Wno-, test=develop

* modify ~MatmulDescriptor

* mess

* remove -Wimplicit-fallthrough, test=develop

* remove -Wimplicit-fallthrough, test=develop

* remove -Wimplicit-fallthrough, test=develop

* remove -Wimplicit-fallthrough, test=develop

* remove , test=develop

* support auto generate static for randperm

* remove enforce in randperm infermeta

* add bfp16 test for isfinite

* fixed for ci

* deal with comments

* fixed test

* skip test in cpu

* deal with comments

* fixed for ci

* fixed testcase

* fixed for ci

* fixed for testcase

* fix error in generator/type_mapping.py

* support auto generate for op merged_momentum optimizer

* support auto generate for flatten (flatten_contiguous_range)

* add data_type for flatten_grad

* Add output defs for eigh kernel

* fix

* update

* update

* fix

* fix

* add autogen code support for reverse op

* bug fixed

* support auto generate for op momentum optimizer

* remove momentum_op.* and update signature

* fix dgc momentum op maker error

* remove paddle/infrt/

* delete .lit_test_times.txt

* autogen segment_pool

* delete legacy_dygraph about segment_pool

* delete paddle/fluid/operators/*_npu.*

* try pass CI

* try pass CI

* add_fp_bf_for_flip_gaussian_random

* forget convert uint

* fix some error

* fix some error

* delete paddle/fluid/operators/*_npu.*

* try pass code-style

* support set master_grad

* move register_hook to auto_cast

* update unittest

* fix fp16 test

* update for review comments

* Support two inputs of multihead attention named qk_multihead

* [Opt Performance] Optimize custom operator performance, reconstruct python API auto-gen, add cache and use const inference

* opt AutoGradMeta implementation

* remove profiler codes

* fix unit test

* change year, 2021->2023

* fix int64_t parse bug