* move diag_embed to phi.

* [Phi] migrate exponential kernel to phi

* fix comment

* fix CI

* migrate as_complex kernel to phi

* support as_complex and as_real in phi

* rm GetExpectedKernelType for AsRealOp

* Move angle op to phi

* Replace mutable_data using Alloc

* Remove some include

* Try to fix windows ci error

* include math.h to fix windows ci error

* Fix kernel name

* Move angle_grad infershape

* draft version

* draft version

* draft version

* migrate solve kernel to phi

* polish

* polish

* re useless header file, fix a bug in grad_kernel_impl

* add header file in need

* transfer as_real to phi

* fix erros

* blocking: True -> False

* sparse support amp

* EagerAmpAutoCasts support sparse

* mv to phi

* refine infermeta code position

* refine grad code

* add api yaml and add final_state_api

* refine code

* fix transform data

* fix dropout kernel

* Revert "fix transform data"

This reverts commit ada75ecd169ea194ce43f7ed75dcc968f5ed2fb9.

* remov merged_adam_op to phi

* refine code

* clean glog header in public header

* move marco pos

einsum support complex and add unittest.

* refine dist_grad kernel

* fix cpu kernel bug

* refine dist kernel, reuse norm

* follow comments

* 2nd part of transpose update

* add switch_auto_tune option.

* add some changes according to Ci

* refine the structure of auto_tune_base.

* merge develop changes

* reset the switch_set_range and change unittest of transpose auto-tune

* change the kernel auto-tune logits

* add relu6 kernel and yaml

* format files

* format code and fix bug

* fix build failed

* perfect copy

* deal with conflict

* deal with conflict

* fix compile bugs

* fix unittest bugs

* change code format

* deal with conflict

* modify code by review

* fix ce bugs

* fix ce bugs

* add lo

* perfect code format

* deal with conflicts

resort .cu headers, set clang-format not sort include block and consider .cu as main source file (#43633)

Co-authored-by: NLiu Yiqun <liuyiqun01@baidu.com>

* move_group_norm

* move group norm backward

* fix code format

* modify code according comment

* support heter reindex

* add unittest, fix bug

* add comment

* delete empty line

* refine example

* fix codestyle

* add disable static

* extend forward fast_ln_kernel to support more column values.

* add yaml

* fix infrt compile bugs

* rrelu逻辑部分

* unregistered op kernel (unresolved)

* commit before merge

* 丰富测试用例

* 修复rrelu-sig的bug

* 修复cpu环境测试

* 修改拼写错误

* 修改code format

* 尝试优化测试用例timeout的问题

* 优化测试用例

* 移除seed, 优化随机函数

* update en doc for rrelu

* fix rrelu en docs, test=document_fix

* add paper link for en docs, test=document_fix

* udpate en doc

* add r,test=document_fix