* remove with_data_parallel in custom op test

* finish TestCustomOpReluModelStaticMultiDevice

* fix typo

* add checks for relu output

* fix ci

* fix ci

* fix compile checks

* fix coverage ci

* [AMP OP&Test] Modify the logic of comparing grad in bfloat16

* add numel INT64 register

* del numl

* add svd UNDEFINED register

* remove svd register

* remove operator.h from blas.h and remove paddle::framework::ExecutionContext

* remove the deps for GetBlas(exe_ctx)

* fix error

* [xpu-ernie3] support fp16 for full_like/stack/where xpu kernels

* [xpu-ernie3] support fp16 for full_like/stack/where xpu kernels

* AMP arange & Test

* fix arange bfloat16 dtype

* update for review

* update for review2

* fix tile

* update

* fix ci

* r

* f

* fix windows ci

* update bfloat data

* fix bloat16 input

* add print

* Update test_where_op.py

* update kernel

* del repeat

* update review

* where op test

* update bfloat16

* fix

* fix windows ci

* update bfloat16 data

* fix bloat16 x

* reset

* fix randint

* add print

* add delta

* cancel print

* code style

* update revirew

* move fluid.utils to paddle.utils.layers_utils

* fix error

* delete original fluid layers utils

* remove import and old utils

* remove more old utils import

* change import path of fill_constant in the layers_utils.py

* fix mistake

* fix error

* expose in __init__.py

* for comment

* when change the ref of func is_sequence, it should change to the root of is_sequence instead

* for codecheck

* add prim erf grad

* add yaml config for prim erf grad

* add math.h

* add cmath

* add math  defines

* use define math

* use define math

* define M_2_SQRTPI

* M_2_SQRTPI math

* try math.h

* fix typro

* remove pow in erf grad

* use new optest

* add fp16 fp32 test

* remove fp16 test

* Add the collect and print of kernel registry infomation in op benchmark ci.

* Little change to test the ci.

* Remove the reduntant function.

* Move the collect of kernel registry information to the end of ci.

* support run haokanctr model in heterps-models

* polish setup.py

* polish JVM_LIB in evn_dict

* add softplus double grad

* use constant method

* support elementwise_pow bfloat16

* add only_check_prim parameters in check_grad

* modify unit test

* fix floor test

* fix sigmoid bfloat16 test

* norm some ops prim test

* add unit16 for sqrt

* fix accuracy and activation

* add adadelta

* support pad2d

* support pad

* modify exponential and linear_interp_v2

* modify meshgrid test

* add group_norm

* support some ops

* modify activation&group norm

* modify act

* reset group_norm

* modify acti

* modify pow test

* modify acti

* lint

* modify mkldnn test

* fix acti

* modify adadelta

* lint

* fix act mkldnn

* reset acti

* [clear ps] del some all list

* [clear ps] for ci

* [clear ps] rm fluid emb

* split_list

* support reshape test on prim and cinn

* fix mkldnn test

* polish test case

* register custom kernel for all type of custom device

* fix bug

* fix GetKernelInputArgDef

* fix amp bug

* fix TransToPhiPlace

* adapt interpreter_util

* add output defs for fused_adam kernel

* complete the oters defs for cpu and gpu

* remove register for param_out

* Add output defs for sgd kernel

* add datatype infer for sgd

* add infer logic

* [Dy2St]Enhance @to_static auto-skip paddle inner API

* fix comment

* fix class method

* add output defs for edit_distance kernel

* change seqnum as output0

* add REGISTER of float32 in accuracy

* fix something