* [CustomDevice] add pipeline parallel support

* update

* update

* delete overwrite from gather_grad

* fix

* Update gather_grad_kernel.cc

* [XPU] fc use int_with_ll_t

* fix test_unbind_op_xpu

* remove axis from elementwise_grad

* Update elementwise_sig.cc

* relocate metri_op.py

* reloacte nn.py

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix variable->tensor and fix __all__

* fix ctr_metric_bundle and sparse_embedding

* fix bug of function init

* fix bug of importing sparse_embedding and ctr_metric_bundle

* fix bug

* Update __init__.py

* apply gcc12 to gpups

* apply gcc12 to gpups

* apply gcc12 to gpups

* apply gcc12 to gpups

* apply gcc12 to gpups

* apply gcc12 to gpups

* apply gcc12 to gpips

* apply gcc12 to gpups

* apply gcc12 to gpups

* test

* test

* apply gcc12 to gpups

* apply_gcc12_to_gpups

* fix compiler bug

* fix compiler bug

* test

* fix dangling-pointer compiler

* fix dangling-pointer compiler

* fix dangling-pointer compiler

* apply_gcc12_to_gpups

* apply gcc12 to gpups

* Update cuda_streams_py.cc

* Delete temp param in eager_gen

* test,test=develop

* test,test=develop

* test,test=develop

* test,test=develop

* test,test=develop

* test,test=develop

* test,test=develop

[Zero-Dim] support output 0D for is_empty/as_complex/inner/dot/rank/tensordot/squeeze_/static.accuracy/static.auc/metric.accuracy, test=allcase (#52850)

* [Zero-Dim] support output 0D for is_empty/as_complex/, test=allcase

* [Zero-Dim] support output 0D for is_empty/as_complex/, test=allcase

* add test case

* modify dot/metric.accuracy/static.accuracy/static.auc

* modfiy inner/tensordot bug

* test 9 api

* [Zero-Dim] support output 0D for is_empty/as_complex/inner/dot/rank/tensordot/squeeze_/static.accuracy/static.auc/metric.accuracy, test=allcase

* fix bug

* support output 0D for is_empty/as_complex/inner/dot/rank/tensordot/squeeze_/static.accuracy/static.auc/metric.accuracy

* code style

* fix bug

* fix test_dot_op bug

* fix accuracy bug

* fix bug

* fix bug

* fix bug

* fix bug

* codestyle

* fix dot bug

* fix dot bug

* fix dot bug

* code style

* fix dot bug

* fix dot bug

* fix dot bug

* fix dot bug

* fix dot bug

* fix dot bug

* modify code

* add tile_grad composite rule

* support 0-D output and 0-D as indice in __getitem__

* fix tests

* fix inference and UT

* add unittest for setitem

* fix xpu test

* fix xpu 0-d

* add deterministic embedding grad kernel

* minor change

* minor change

* Add new FLAG to enable deterministic embedding

* Update embedding deterministic kernel

* support auto generate for op adam optimizer

* remove unnecessary files

* support auto generate for op adamw optimizer

* support auto generate for op merged_adam optimizer

* use manual_signature in adam_

* Fix bug of reduce_sum op. When input.numel() > INT32_MAX, its result
is wrong.

* Remove climits.

* Fix bug of BlockDesc::MoveFrom(). It's used to rebuild main_program_desc from ProgramDesc modified by Fusion Pass. As some fused operators need to create new Variables in modified ProgramDesc, MoveFrom function uses std::move() function to move these VarDesc to main_program_desc. As a result, their pointers holded by modified ProgramDesc become nullptr. When call block()->Program()->proto() function, it will call ProgramDesc::Flush() function at first, which may cause a segmentation fault.

* mv inference/api infer_ut

* mv test

* merge develop fix error

* fix

* fix build error

* fix build error

* fix bug

* fix tester_helper.h

* fix analyzer_transformer_profile_tester.cc

* fix

* fix mac

* fix mac

* fix error

* fix

* fix

* Revert "remove ASCEND* keyword (#53046)"

This reverts commit 7fa415ca.

* Delete ascend_trigger_op.cc

* revert-53046-remove_ASCEND_keyword

* update

* update

* test,test=develop

* test,test=develop

* test,test=develop

* test,test=develop

* support_0D_output_for_matrix_rank_multi_dot, test=allcase

* add 0D output test for matrox_rank and mutli_dot test=allcase

* fix assert error ,test=allcase

* fix test error, test=allcase

* fix other test error, test=allcase

* fix other test error, test=allcase

* fix test error, test=allcase

* fix matrix_rank and multi dot test err test=allcase

* fix test error test=allcase

* fix test zero dim test, test=allcase

* add static backward test for multi_dot, test=allcase

* add tol 2d broadcast test case, test=allcase

* [XPU] add numel op

* [XPU] update numel/size op registration

* setup

* Update elementwise_kernel.cc

* Update elementwise_kernel.cc

* fix

* fix

* Update elementwise_kernel.cu

* fix

* Update elementwise_kernel.cc

* Update elementwise_kernel.cc

* Update elementwise_kernel.cc

* Update elementwise_kernel.cc

* Update elementwise_kernel.cc

* Update elementwise_kernel.cc

This reverts commit 543efcc5.

* add flash randomness control

* fix VLOG undefied

* remove ASCEND* keyword

* update docstring

* bug fixed

* bug fixed

* [CustomOP error] Add attrs type check

* fix global variable order bug

* include unordered_set

* fix ParseAttrStr compile error

* update

* update

* Revert "update"

* fix bug

* update