* Fix nan in fast_ln_fwd_kernel when cols > 1024

* delete blas

This reverts commit bbe99555.

* fix op_role

* fix engine

* update op_role

* feat(): dynamic_to_static support for ipu.

* fix(): format fix.

* fix format

* fix cpplint error

* use phi::errors

* fix format

* fix format

* fix(): add api to restore patched function.

* fix(): identity_loss uses cpu place as expected kernel type.

* doc(): add IPU dy2static related docs.

* fix(): combine test cases.

* fix format

* fix comment

* fix format

* apply comment

* fix compiling

* fix(): align docs.

* fix(): fix identity_loss function docs.

* fix(): adjust mean and sum in identity_loss.

* fix(): minor docs.

* move API to paddle.incubate.identity_loss

* fix UT
Co-authored-by: Nzhaorui chen <zhaoruic@graphcore.ai>

* fused_gate_attention manual code in eager

* fix deriv with inplace

* fix double grad bugs

* remove additional file

* fix compat dygraph mode

* fix yaml remove additional yaml

* fix slice double grad error and auto code gen logic error for higher order differentiate

* fix fix_higher_order_deriv

* remove additional include

* fix fix_higher_order_deriv

* fix for binary kernels

* fixed performance for elementwise, reduce and concat

* added comment

* CI fix

* CI fix

* added formatting

* reverted one file

* Revert "reverted one file"

This reverts commit 54725e1c62318d3a18913821200e973816751019.

* Revert "added formatting"

This reverts commit b9795dd253d755a329376d7ab0542860aa7815c6.

* added enforcing oneDNN BF16 reduce kernel

* fix for eltwise and reenabled reshape kernels

* fix for binary handler

* added formatting

* referted changes for flatten,squeeze and reshape ops

* nvcc_lazy

* nvcc_lazy

* conv_fusion

* add support for control flow block analysis

* move FunctionNameLivenessAnalysis into utils

* pass test_ifelse.py

* remove duplicate data_layer_not_check

* pass the test_ifelse.py

* fix unittest error .

* fix all ci error in first version

* temporay disable CreateVariableTransformer

* fix ci errors

* fix function name liveness analysis bugs

* modifty def cond

* fix

* fix ci error - v2

* fix by code review

* change return_name_ids -> return_name

* Fc add any to input format

* Pre-commit changes

* support inpus is weight

* merge prepare_data and prepare_phi_data in static graph

* fix bug

* fix data transform bug

* fix bug

* fix unittest of cinn

* not run startup program in constructor of StandaloneExecutor

* clear interface of standalone executor

* clean debug code

* fused_gate_attention manual code in eager

* Menual fused_feedforward in eager

* fix test case

* conv_fusion

* Dataloader add custom device support

* update test=document_fix

* - blind shot fix

* - workaround

* - compilation fix

* - Hack

* open ut in windows-inference;test=document_fix;test=windows_ci_inference

* test=document_fix;test=windows_ci_inference;disable failed tests temporarily in windows-inference

* Fix for ernie3.0 int8

* Move changes above comment

* Refactor quantization of immutable ops

* Fix code formatting

* Fix formatting

* Specify input names

* Fix formatting

* Change string to reference

* Formatting

* [Sparse] add SparseCsrTensor fused_attention kernel and API

* fix comment

* refactor mean op, *test=kunlun

* refactor mean op, *test=kunlun

* refactor mean op,*test=kunlun

* refactor mean op,*test=kunlun

Modify the unittests of the assign_value, iou_similarity, one_hot_v2, reduce_mean, roi_align op. test=kunlun (#44061)

* change fluid.mean to paddle.mean

* reverse some old code examples

* make only win32 and 11.6 use external/cub

* unify cub version in linux and windows when cuda >= 11.6

* refine tensor.dtype for bloat16

* refine test

* revert

* refine bfloat16 print