* decouple memory copy

* fix ci bugs

* fix ci compile bugs

* fix rocm compile

* fix ci bugs

* comp gather_nd_grad

* fix

* test no cinn

* fix

* fix cinn

* patch on gloo/types.h

* fix patch

* change patch dir

* add patch

* [CustomDevice] fix process_group_custom api

* update

* update

* update

* update

* Check structed kernel for new executor static build

* Update code

* Ready for resnet50

* Move transfer_dtype to phi

* Ready for transformer

* Fix CI errors

* Fix layer_norm InferMeta

* Remove layer_norm infermeta fix

* first commit

* finish base work

* modification for good

* fix for cache setting and gather the algo and desc as one data for cache storage

* fix for cache setting and gather the algo and desc as one data for cache storage

* install pre-commit check

* add_trt_tile

* tile_trt

* fix performance drop in BF16 models

* fix test_cpu_quantize_squash_pass

* fix prim_op_test when python api outs is different with kernel sig

* add elementwise op prim test

* fix unit test

* add bfloat16 for full in static  prim api

* empty-commit

* close bf16 test

* polish elementwise tests

* fluid clean: remove parallel and parallel_helper api

* fix: fix the import path.

* fix DataParallel imports issue

* fix attrs copy error

* fix bert by fix slice error

* fix op test

* fix gcc12 error

* patch on device.cc

* fix gcc error while compiling gloo

* [dy2static] bugfix: make stop_gradient a cache key
1. make stop_gradient cache key in dy2static.

* fix ci errors

* fix ci error

* fix ci error

* fix ci error

* fluid clean: remove dygraph_utils._append_bias_in_dygraph

* fix func name and imports

* polish codes according #50813

* [getCurrentCUDAStream] Add C++ API getCurrentCUDAStream

* change get->Get

* wrap with macro

* use Get instead of get

* register fp16 and bf16 kernel for uniform_random

* fix compile

* support selected_rows

* add ut

* revert cpu

* fp16 test skip cpu

* [cinn] concat_grad

* [cinn] concat_grad

* [cinn] concat_grad build success

* [Add PGLBOX] fix unnitest

* [Add PGLBOX] fix unnitest

* [Add PGLBOX] fix codestyle

* [cinn] update by comments

* [cinn] update by comment

* [cinn] add axis check

* add dialect

* add some interface for dialect

* add some dialect interfaces for class Type

* set WITH_NEWIR=OFF

* refine code by comment

* polish code

* refine include style

* refine log for debug

* add composite op hard swish

* add test grad

* update apis calling

* update date range

* add ut

* tune off cinn for 0-d shape

* skip cinn

* split generated_op.cc into 4 src files

* fix bug

* fix compile on windows

* flash attn

* seed

* almost

* softmax

* fix workspace

* add unitest; linux only

* fix setup

* fix datatype include

* fix setup typo

* fix def scope

* new error api

* use paddle fork

* fix attr bug; complete ut

* update flash hash

* fix rng reset

* fix offset

* fix comments

* fix sqrt grad

* fix sqrt grad