* add all_gather and fix conflicts

* fix code format

* fix ut

* fix broadcast ut

* Replace paddle::experimental::DataType as phi::DataType

* restore custom_device.cc

* Add output defs for mode kernel

* fix bug

* add fp16/bf16

* add grad bf16

* test name

* Add output defs for conv3d_coo distribute_fpn_proposals kernel

* fix

* add register of KthvalueKernel

add register of KthvalueKernel

* Update kthvalue_kernel.cc

* Update kthvalue_kernel.cu

* Update interpreter_util.cc

* Update auc_kernel.cc

* Update auc_kernel.cu

* Update auc_kernel.cc

* Update auc_kernel.cu

* Update interpreter_util.cc

* Update bincount_kernel.cc

* Update bincount_kernel.cu

* Add output defs for all_close all_raw  kernel

* Update interpreter_util.cc

* add register of yolo_loss_kernel.cc

* fix something

* Update paddle/phi/kernels/cpu/yolo_loss_kernel.cc

* delete something in interpreter_util.cc

* rollback

* add REGISTER of angle

* bug fix

* fix something

* Update paddle/phi/kernels/gpu/angle_kernel.cu

* Update paddle/phi/kernels/cpu/angle_kernel.cc

* Update paddle/phi/kernels/gpu/angle_kernel.cu

* Update paddle/phi/kernels/cpu/angle_kernel.cc

* add numel INT64 register

* del numl

* add svd UNDEFINED register

* remove svd register

* add softplus double grad

* use constant method

* add output defs for fused_adam kernel

* complete the oters defs for cpu and gpu

* remove register for param_out

* add output defs for edit_distance kernel

* change seqnum as output0

* add REGISTER of float32 in accuracy

* fix something

* * add comm context for device context

* add broadcast phi operator kernel and api

* add broadcast support dtype, update ut

* fix broadcast bfloat16 type

* fix ut

* update test_collective_broadcast_api timeout to 300

* add visit_place to phi/core/utils

* remove reference to operator.h in phi/kernels/funcs/math_function.h

* update data type from framework.proto to phi

* fix enforce error in fluid

* add isfinite

* add isnan & isinf

* add xpu isNaN

* add output defs

* add output defs for kps

* add bf16 fp16 type support for interpolate

* add bf16 fp16 support for interpolate in phi on cpu

* move DeviceContextPool to phi

* add EmplaceExternalContextFunc

* update namespace

* update cmake

* fix bugs and create context_pool_impl.h

* replace platform::is_xxx_place

* fix bugs

* update generator

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix enforce usage

* Revert "fix enforce usage"

This reverts commit 5f521f08a69713cee506e64a00ec6d9fba709e27.

* fix bugs

* rm XPUDeviceContext and CustomDeviceContext

* fix bugs

* fix fix context init bug

* fix bugs after merge

* fix bugs

* fix name

* fix mutable_data

* update and fix bugs

* fix bugs

* update

* fix bugs

* fix name

* fix bugs

* merge

* fix bugs

* create context_pool in phi/backends

* create context_pool in phi/backends

* fix bugs

* fix xpu bugs

* fix rocm bugs

* fix bugs

* fix bugs

* fix bugs

* fix xpu bugs

* update

* update

* fix bugs

* fix bugs

* [phi] move jit kernels from fluid to phi

* [phi] fix paddle::phi err

* [phi] fix windows 'posix_memalign': identifier not found

* [phi] fix windows 'posix_memalign_free': identifier not found

* [phi] fix readme directory structure, fc_functor  paddle::platform

* decouple memory copy

* fix ci bugs

* fix ci compile bugs

* fix rocm compile

* fix ci bugs

* Check structed kernel for new executor static build

* Update code

* Ready for resnet50

* Move transfer_dtype to phi

* Ready for transformer

* Fix CI errors

* Fix layer_norm InferMeta

* Remove layer_norm infermeta fix

* remove utils

* remove utils

* remove utils

* remove utils

* Update get_data_from_tensor.h

* Update rnn_functor.h

* Update rnn_grad_kernel.cu.cc

* Update rnn_kernel.cu.cc

* Update rnn_kernel.cc

* Update rnn_grad_kernel.cu.cc

* Update rnn_functor.h

* Update rnn_kernel.cu.cc

* Update rnn_kernel.cc

* remove utils

* Update rnn_functor.h

* remove utils

* remove utils

* remove utils

* remove utils

* remove utils

* Update rnn_functor.h

* Update unsqueeze_op.h

* Update utils.h

* roll back

* Update tensor_utils.h

* Update tensor_utils.h

* Update tensor_utils.h

* Update tensor_utils.h

* Update tensor_utils.h

* use TensorToVector

* use TensorToVector

* use TensorToVector

* use TensorToVector

* use TensorToVector

* Update rnn_kernel.cc

* Update rnn_grad_kernel.cc

* Update rnn_functor.h

* Update rnn_grad_kernel.cu.cc

* Update rnn_kernel.cu.cc

* Update rnn_functor.h

* Update rnn_grad_kernel.cu.cc

* Update rnn_kernel.cu.cc

* Update rnn_functor.h

* Update rnn_grad_kernel.cu.cc

* Update rnn_kernel.cu.cc

* add TensorToVector

* roll back

* Update tensor_utils.h

* Update rnn_functor.h

* Update rnn_grad_kernel.cu.cc

* Update tensor_utils.h

* Update rnn_kernel.cu.cc

* Update rnn_grad_kernel.cc

* Update rnn_kernel.cc

* Update rnn_grad_kernel.cu.cc

* Update rnn_kernel.cu.cc

* Update rnn_grad_kernel.cc

* Update rnn_kernel.cc

* TensorCopySync to phi::Copy

* fix codestyle

* rnn_kernel.cc: add ;

* replace all GetDataFromTensor with phi::GetVectorFromTensor

* delete include of util.h