* draft version

* draft version

* draft version

* migrate solve kernel to phi

* polish

* polish

* re useless header file, fix a bug in grad_kernel_impl

* add header file in need

* transfer as_real to phi

* fix erros

* blocking: True -> False

* remove auto to_pascal_case for args in op generator

* fix yaml config

* update xccl lib
    * use separate streams for compute/comm on XPU
    * add broadcast op to xpu2_op_list

* sparse support amp

* EagerAmpAutoCasts support sparse

* adapt mkldnn kernel in PHI

* fix ci compile bugs

* fix compile bugs

* fix compile bugs

* fix compile bugs

* fix compile bugs

* delete comment

* fix compile bugs in windows-inference

* delete code for converage

* modify code by review

* modify code by review

* add todo

* fix compile bugs

* fix compile bugs

* fix compile bugs

* fix unittest bugsx

* [CustomDevice] add custom ccl api

* add ut

* Move eigvals OP to PHI

* Fix CI errors

* Fix CI errors

* opt sparse_mask

* [Phi] Migrate matrix_solve to phi

* replace mutable_data with Alloc

* add sparse api coalesce

* mv to phi

* refine infermeta code position

* refine grad code

* add api yaml and add final_state_api

* refine code

* [CustomKernel] add capi eager mode support

* add ut

* add capi test

* fix cpu lars_momentum bug & add xpu grad_add/log_softmax/log_softmax_grad
*test=kunlun

* minor
*test=kunlun

* fix transform data

* fix dropout kernel

* Revert "fix transform data"

This reverts commit ada75ecd169ea194ce43f7ed75dcc968f5ed2fb9.

* remov merged_adam_op to phi

* refine code

* clean glog header in public header

* move marco pos

einsum support complex and add unittest.

* refine dist_grad kernel

* fix cpu kernel bug

* refine dist kernel, reuse norm

* follow comments

* feat(): dynamic_to_static support for ipu.

* fix(): format fix.

* fix format

* fix cpplint error

* use phi::errors

* fix format

* fix format

* fix(): add api to restore patched function.

* fix(): identity_loss uses cpu place as expected kernel type.

* doc(): add IPU dy2static related docs.

* fix(): combine test cases.

* fix format

* fix comment

* fix format

* apply comment

* fix compiling

* fix(): align docs.

* fix(): fix identity_loss function docs.

* fix(): adjust mean and sum in identity_loss.

* fix(): minor docs.

* move API to paddle.incubate.identity_loss

* fix UT
Co-authored-by: Nzhaorui chen <zhaoruic@graphcore.ai>

* fix deriv with inplace

* fix double grad bugs

* remove additional file

* fix compat dygraph mode

* fix yaml remove additional yaml

* fix slice double grad error and auto code gen logic error for higher order differentiate

* fix fix_higher_order_deriv

* remove additional include

* fix fix_higher_order_deriv

* Dataloader add custom device support

* update test=document_fix