* decouple reduce_any_op.h and reduce_op.h from reduce_any_op.cc

* support auto generate for static op reduce_any

* fix inference static lib bugs

* add if for copy

* fix py3 bugs

* change phi to static for inference

* fix py3 bugs

* fix ci-inference

* fix inference bugs

* perfect code

* revert to paddle op when matrix_multiply cannot enter into paddle-trt 

* fix mac typeinfo bugs

* add file

* move code to cc

* fix compile bugs

* [CustomDevice] add barrier op

* update

* change pyobject_isinstance

* change pyobject_isinstance

* support master_grad for adam and momentum

Co-authored-by: zhangting_2017@163.com <zhangting2020>

* function

* remove print

* add some pystate

* static graph autogen code for shape op

* fix onednn

* fix onednn

* add build

* add build

* refine code

* refine code

* refine code

* refine code

* refine interface

* fix bug

* fix bug

* fix bug

* refine yaml

* revert sequence_enumerate_op

* restore sequence_enumerate_op

* support layer_norm prim op bf16 dtype

* polish code

* resolve conflict

* [ROCM] fix multihead_matmul

* skip bf16 uts

* update

* static graph autogen code for check_finite_and_unscale_ op

* bug fixed

* update

* update cmake

* update

* update

* update

* update

* Revert "update cmake"

This reverts commit 1e1dc1b2bc9967b725201272607f939260070fd4.

* update

* update

* update

* update

* [AutoParallel] update while control_flow with pipeline

* update process group instantiate

* fix micro_bsz for reshard

* update api for micro batch size

* add strategy for dp optimization

* mv all unittests test

* fix error

* fix error

* fix

* fix

* del unittests

* fix paddle_build.sh

* fix

* fix test

* fix add test

* fix

* fix

* fix

* merge develop

* fix

* fix

* fix

* fix

* fix

* merge develop

* fix test_async_read_write

* fix test_async_read_write

* merge develop

* fix

* fix import legacy_test

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix bug

* fix

* fix coverage test bug

* fix

* fix

* fix

* fix

* fix

* fix code sstyle

* fix code

* fix code

* fix

* fix

* fix

* del test_sequence_enumerate_op.py

* fix

* add infer_shape interface

* update

* support auto generate for static op reduce_amax

* set reduce_amax attr 'axis' type as IntArray

* fix inference static lib bugs

* add if for copy

* fix py3 bugs

* update_c++17

* update_c++17

* fix windows bug

* solve cirle depend

* solve cirle depend

* solve cirle depend

* solve cirle depend

* solve cirle depend

* fix windows bug

* fix compiler error

* fix compiler error

* update eigen3

* update eigen3

* update eigen3

* fix mac-py3 compiler error

* update C++17

* fix mac compiler error

* fix compile error

* fix coverage_compiler error

* fix coverage_ci_problem

* fix coverage_error

* fix_kunlun200 compile error

* fix kunlun200 compiler error

* fix compile error

* fix compiler error

* fix py3 failed test

* fix kunlun200 compiler error

* test

* fix test error

* fix test error

* fix test error

* test

* test

* fix mac py3 error

* fix mac py3 error

* fix mac py3 error

* fix test error

* fix test error

* fix compile error

* fix compile error

* fix compile error

* test

* test

* fix compiler error

* test

* test

* debug on ci

* fix compiler error

* fix compiler error

* test

* fix cinn compiler error

* test

* fix rocm cmpile error

* fix cinn and kunlun compile error

* update c++14

* Update flags.cmake

* Reimplement the check_nan_inf function as check_numerics kernel.

* Remove the cpu implemention to phi.

* Add ifdef for the including of omp.h.

* Move the use of FLAGS_check_nan_inf_level out of header file.

* Implement a common PrintAndThrowError function.

* Fix the error using of __NVCC__, which should be instead with __CUDA_ARCH__.

* Add dependency of phi.

* Polish codes and unittest.

* add timer to log deps

* rename flag

* add ut