* Support predictor function in JitLayer

* Pybind PEFunction

* Pybind PEFunction and call phi api in layer_test

* Call sqrt phi API

* Polish flags

* Fix comments

* [Dy2Sta]Fix Segment Fault while training multi-card if params have no grad

* fix unittest

* add slot attr for push sparse op

* add pybind

* remove fleet

* add unittest

* fix

* add xpu pnorm op and fix pool op, *test=kunlun

* add adaptive pool, and softmax with cross entropy supports different axis, *test=kunlun

* fix some error found in tipc.

* update

* convfusionfp16

* convfusionfp16

* convfusionfp16

* seperate xshape kernel from normal kernel

* fix bugs in infermeta

* fix compile bugs

* fix compile bugs

* move diag_embed to phi.

* [Phi] migrate exponential kernel to phi

* fix comment

* fix CI

* Update ps_gpu_wrapper.h

* Update ps_gpu_wrapper.h

* Update ps_gpu_wrapper.cc

* add adam/sharedadam optimzier for gpups;edit optimizer struct;test=develop

* fix CreateVarNode in multi_devices_graph_pass

* Revert "Fix var duplication bug for graph_to_program_pass (#44278)"

This reverts commit a2c4c86b.

* device_guard support xpu. test=kunlun

* sum op of xpu support LoDTensorArray. add test for while op of xpu. test=kunlun.

* fix FleetWrapper initialize

* migrate as_complex kernel to phi

* support as_complex and as_real in phi

* rm GetExpectedKernelType for AsRealOp

* Add dependency for read op in standalone executor

* Fix CI errors

* Add UT

* add_dependency -> dependency_utils

* Fix CI errors

* [IPU] Add more Ops

* update boost API

* compile into one static library

* fix xpu compile

* fix xpu compile

* fix inference compile

* fix inference compile

* add custom test

* revert one file

* release gil when run backward

* Move angle op to phi

* Replace mutable_data using Alloc

* Remove some include

* Try to fix windows ci error

* include math.h to fix windows ci error

* Fix kernel name

* Move angle_grad infershape

* move eig operator from fluid to phi

* add eig_grad unitest, upgrade IsComplexType() from fluid to phi

* add save_cache/patch

* add pybind

* remove pybind

* remove const_cast

* add fleet

* Piotrek's changes for pad3d

* my changes

* first version of pad3d, single copy, unnecessary reads

* optimized pad3d kernel

* test upadte

* removed magic numbers

* added support for pad2d

* reverted two files

* reverted one old change

* added support for Paddings tensor

* CI fix

* CI fix

* fixed timeout of tests

* fixed typo

* changes to GetKernelTypeForVar

* Revert "changes to GetKernelTypeForVar"

This reverts commit 469106115c49682b25038a666fd71bd4a10fb66b.

* added AsExtra() to pad2d
Co-authored-by: NPiotr Paturej <piotr.paturej@intel.com>

* Rename BOOST_GET macros

* Fix conflicts

* add labels for infer ut

* add RUN_TYPE=INFER for cpp ut

* fix formaterror

* update

* migrate solve kernel to phi

* re useless header file, fix a bug in grad_kernel_impl

* add header file in need

* add yaml for solve op

* fix solve_sig.cc ArgumentMapping and update tests case

* disable legacy dygraph check in op_test

* rm solve_op.cc / solve_sig.cc and migrate yaml config

* Update op_test.py

disable legacy dygraph check when check_eager is True

* shape sum

* add shape, sum trt layer

* add xpu resnet_unit
*test=kunlun

* tmp
*test=kunlun

* test

* update