* optimize bias_add reluv2 in half2

* Add annotation

* refine code format

* cast to higher precision type to prevent fp16 diff problem

* fix bilinear backward and add more unittest case

* change staticRNN to while

* update code

* fix rnn bug

* update

* fix _find_op_path_ bugs in append_backward.

* polish code

* revert op proto

* update

* udpate while

* format

* revert test while loop op

* fix create array

* fix windows error

* fix bug

* update

* fix array write bug
Co-authored-by: Nxiongkun <xiongkun03@baidu.com>

* add validity check for config in yaml

* delete debug log

* move IsFloatVar() from tensorrt/ to api/

* fix wrong handler name

* mkldnn_engine -> onednn_engine

* remove fluid/errors.h imports

* remove fluid/enforce.h imports

* remove note and unnecessary import

* remove fluid/pretty_log.h imports

* remove fluid/place.h imports

* remove fluid/data_layout_transform.h imports

* remove fluid/device_context.h imports

* remove mkldnn_helper code

* remove fluid/mkldnn_reuse.h imports

* pretty_log import

* memory_optimize and mkdlnn problem

* update

* update

* update

* fix c++17-extensions warning on macos

* fix type

fix c++17-extensions warning on macos

fix c++17-extensions warning on macos

* First Commit.

* add some codes

* add elementwise loader

* fix code styles

* merge with develop

* add some changes both in elementwise and transpose

* add init operation in broadcast kernel.

* change codes according to pr suggestions about transpose file

* fix error for op-benchmark ci

* fix according to ci

* nullptr bugfix for XPU pg mode

Also a few kernels is added to xpu whitelist

* increase error msg length

* modify cmake file for cuda11.8 compile

* add op_library(fused_embedding_eltwise_layernorm_op DEPS bert_encoder_functor)

* test=doucment_fix

* test=document_fix

* Deleted mkldnn_inplace_pass code

* Fixed error with cmake

* Resolve conflicts

* add more unary op and square

* fix rmsprop_ yaml bug

* save fused_attention memory when dropout_rate = 0.0

* add ut

* fix ut bug

* fix fused_layernorm_residual_dropout_bias_test.cu

* generate static graph code of some ops by yaml

* fix the code-style of yaml

* fix the framework_ci for triangular_solve

* change the 'data_type' of scatter

* add the 'out: Out' of scatter_nd_add

* fix some transformer unitest

This reverts commit 592ed40b.

* fit paddle.matmul in fleetx.gpt

* add new tensor

* fix windows compile bugs

* fix ci bugs

* fix ci bugs

* fix ci bugs

* perfect according comment

* fix ci compile bugs

* add raw tensor

* fix ci bugs

* modify code by comment

* delete String

* replace dependency of inclusive_scan.h from phi

* format code