* draft version

* draft version

* draft version

* migrate solve kernel to phi

* polish

* polish

* re useless header file, fix a bug in grad_kernel_impl

* add header file in need

* transfer as_real to phi

* fix erros

* blocking: True -> False

* sparse support amp

* EagerAmpAutoCasts support sparse

* adapt mkldnn kernel in PHI

* fix ci compile bugs

* fix compile bugs

* fix compile bugs

* fix compile bugs

* fix compile bugs

* delete comment

* fix compile bugs in windows-inference

* delete code for converage

* modify code by review

* modify code by review

* add todo

* fix compile bugs

* fix compile bugs

* fix compile bugs

* fix unittest bugsx

* Move eigvals OP to PHI

* Fix CI errors

* Fix CI errors

* opt sparse_mask

* [Phi] Migrate matrix_solve to phi

* replace mutable_data with Alloc

* add sparse api coalesce

* mv to phi

* refine infermeta code position

* refine grad code

* add api yaml and add final_state_api

* refine code

* fix cpu lars_momentum bug & add xpu grad_add/log_softmax/log_softmax_grad
*test=kunlun

* minor
*test=kunlun

* fix transform data

* fix dropout kernel

* Revert "fix transform data"

This reverts commit ada75ecd169ea194ce43f7ed75dcc968f5ed2fb9.

* remov merged_adam_op to phi

* refine code

* clean glog header in public header

* move marco pos

einsum support complex and add unittest.

* refine dist_grad kernel

* fix cpu kernel bug

* refine dist kernel, reuse norm

* follow comments

* feat(): dynamic_to_static support for ipu.

* fix(): format fix.

* fix format

* fix cpplint error

* use phi::errors

* fix format

* fix format

* fix(): add api to restore patched function.

* fix(): identity_loss uses cpu place as expected kernel type.

* doc(): add IPU dy2static related docs.

* fix(): combine test cases.

* fix format

* fix comment

* fix format

* apply comment

* fix compiling

* fix(): align docs.

* fix(): fix identity_loss function docs.

* fix(): adjust mean and sum in identity_loss.

* fix(): minor docs.

* move API to paddle.incubate.identity_loss

* fix UT
Co-authored-by: Nzhaorui chen <zhaoruic@graphcore.ai>

* [Sparse] add SparseCsrTensor fused_attention kernel and API

* fix comment

* fix init()

* delete test_device_context

* replace CPUDeviceContext with CPUContext

* fix test_scalar

* remove dot_op.cc

* fix compile

* unify cpu context

* fix init()

* delete test_device_context

* fix test_scalar

* 2nd part of transpose update

* add switch_auto_tune option.

* add some changes according to Ci

* refine the structure of auto_tune_base.

* merge develop changes

* reset the switch_set_range and change unittest of transpose auto-tune

* change the kernel auto-tune logits

* move standard apis to api.yaml

* revert erfinv

* delete dot_op.h

* fix dot

* rerun ci

* add relu6 kernel and yaml

* format files

* format code and fix bug

* fix build failed

* move cross form legacy_api.yaml to api.yaml

* move diagonal to api.yaml

* [Sparse]add SparseTensor mv kernel(csr*dense_vec->dence_vec, coo*dense_vec->dense_vec)

* fix CI