* add fp32 grad plus fp16 param in adamw

* add python UT

* fix test case

* in test_adamw_op py file, force the moment2 value LE 0

* add a compare option

* remove bf16 fused adam kernel case

* remove contexts in tensor_utils

* update from_blob

* update from_blob

* update from_blob

* fix bug

* fix bug

* add rnn and searchsorted output defs

* add gpu kernel

* fix atan2

* fix

* fix

* fix

* fix error

* fix error

* fix

* skip copy beta pow when use_global_beta_pow=1

* revert infermeta

* register dtype and place

* refine code

* Add output defs for generate_proposals,instance_norm kernel

* fix

* untracked files

* prelu_perf

* remove unused files

* upd

* fix bug

* Revert "Revert "【Hackathon No.67】remove operator.h in blas.h (#50989)" (#51467)"

This reverts commit b9d91531.

* remove cout

* add header

* fix missing header

* fix refer fluid error

* fix missing header

* 更新 repeat_interleave_grad_kernel_impl.h

Change to phi style datatype.

* 更新 repeat_interleave_grad_kernel_impl.h

Fix missing header

* datatype fluid -> phi

* paddle::experimental -> phi

* fix reference error

* fix reference error

* fix reference error

* fix errors

* fix missing FLAGS

* fix missing headers

* fix missing headers

* fix missing headers

* fix missing headers

* fix missing header

* fix missing header

* fix errors

* Delete randperm raw op

* fix

* Delete hardswish_raw op

* fix ut

* add fp16 and bf16 test

* update

* remove device_context include

* fix bug

* fix bug

* finish task

* add static_check and fix unittest.

* add int32/64

* Update test_cross_op.py

---------
Co-authored-by: NZhang Ting <Douyaer2020@qq.com>

* add all_gather and fix conflicts

* fix code format

* fix ut

* fix broadcast ut

* Replace paddle::experimental::DataType as phi::DataType

* restore custom_device.cc

* Add output defs for mode kernel

* fix bug

* add fp16/bf16

* add grad bf16

* test name

* Add output defs for conv3d_coo distribute_fpn_proposals kernel

* fix

* add register of KthvalueKernel

add register of KthvalueKernel

* Update kthvalue_kernel.cc

* Update kthvalue_kernel.cu

* Update interpreter_util.cc

* Update auc_kernel.cc

* Update auc_kernel.cu

* Update auc_kernel.cc

* Update auc_kernel.cu

* Update interpreter_util.cc

* Update bincount_kernel.cc

* Update bincount_kernel.cu

* delete something in interpreter_util.cc

* rollback

* add REGISTER of angle

* bug fix

* fix something

* Update paddle/phi/kernels/gpu/angle_kernel.cu

* Update paddle/phi/kernels/cpu/angle_kernel.cc

* Update paddle/phi/kernels/gpu/angle_kernel.cu

* Update paddle/phi/kernels/cpu/angle_kernel.cc

* add numel INT64 register

* del numl

* add svd UNDEFINED register

* remove svd register

* AMP arange & Test

* fix arange bfloat16 dtype

* update for review

* update for review2

* fix tile

* update

* fix ci

* r

* f

* fix windows ci

* update bfloat data

* fix bloat16 input

* add print

* Update test_where_op.py

* update kernel

* del repeat

* update review

* add softplus double grad

* use constant method

* add output defs for fused_adam kernel

* complete the oters defs for cpu and gpu

* remove register for param_out

* Add output defs for sgd kernel

* add datatype infer for sgd

* add infer logic

* add output defs for edit_distance kernel

* change seqnum as output0

* add REGISTER of float32 in accuracy

* fix something

* * add comm context for device context

* add broadcast phi operator kernel and api

* add broadcast support dtype, update ut

* fix broadcast bfloat16 type

* fix ut

* update test_collective_broadcast_api timeout to 300