* move inverse from fluid to phi with unitest bug

* fix bug, add eager op yaml

* svd cpu forward

* svd gpu forward

* transfer the backward of svd

* remove cusolver in svd_grad

* svd kernel bug fix

* fix bugs

* fix bugs.

* fix bug

* seperate xshape kernel from normal kernel

* fix bugs in infermeta

* fix compile bugs

* fix compile bugs

* move diag_embed to phi.

* [Phi] migrate exponential kernel to phi

* fix comment

* fix CI

* migrate as_complex kernel to phi

* support as_complex and as_real in phi

* rm GetExpectedKernelType for AsRealOp

* Move angle op to phi

* Replace mutable_data using Alloc

* Remove some include

* Try to fix windows ci error

* include math.h to fix windows ci error

* Fix kernel name

* Move angle_grad infershape

* draft version

* draft version

* draft version

* migrate solve kernel to phi

* polish

* polish

* re useless header file, fix a bug in grad_kernel_impl

* add header file in need

* transfer as_real to phi

* fix erros

* blocking: True -> False

* sparse support amp

* EagerAmpAutoCasts support sparse

* mv to phi

* refine infermeta code position

* refine grad code

* add api yaml and add final_state_api

* refine code

* fix transform data

* fix dropout kernel

* Revert "fix transform data"

This reverts commit ada75ecd169ea194ce43f7ed75dcc968f5ed2fb9.

* remov merged_adam_op to phi

* refine code

* clean glog header in public header

* move marco pos

einsum support complex and add unittest.

* refine dist_grad kernel

* fix cpu kernel bug

* refine dist kernel, reuse norm

* follow comments

* 2nd part of transpose update

* add switch_auto_tune option.

* add some changes according to Ci

* refine the structure of auto_tune_base.

* merge develop changes

* reset the switch_set_range and change unittest of transpose auto-tune

* change the kernel auto-tune logits

* add relu6 kernel and yaml

* format files

* format code and fix bug

* fix build failed

* perfect copy

* deal with conflict

* deal with conflict

* fix compile bugs

* fix unittest bugs

* change code format

* deal with conflict

* modify code by review

* fix ce bugs

* fix ce bugs

* add lo

* perfect code format

* deal with conflicts

resort .cu headers, set clang-format not sort include block and consider .cu as main source file (#43633)

Co-authored-by: NLiu Yiqun <liuyiqun01@baidu.com>

* move_group_norm

* move group norm backward

* fix code format

* modify code according comment