* move decayed_adagrad_op to phi

* fix bug

* support new ir dy2st

* revert code

* skip test with stride

* chang import file

* enable dy2st new ir test part2

* update

* suppor train step

* fix bug

* fix bug

* update

Flatten function docstring case 1 displayed incorrect output

* Fatal bug fix for hapi.eval

When multiple metrics are specified in hapi for eval, the output samples of the model are incorrectly truncated, resulting in inaccurate metric calculations

* fix codestyle

* [enhancement] Implement tensor.cpu() in static graph

* [enhancement] Implement tensor.cpu() in static graph

* [dy2static] add unitest cases for tensor.cpu()

* [dy2static] add unitest cases for tensor.cpu() - run only on paddle compiled with cuda mode

* [dy2static]Refine the format of the api-doc for Variable.cpu().

* Improve GC for pipeline parallel

* Delete print

* update

* update cache

* fix compile error

* open

* update

* new ir remove fetch list

* fix pattern rewrite bug

* try to remove constant fold

* revert code

* add pattern rewrite test flag

* fix multi fetch

* remove usless code

* new ir support legacy kernel instraction

* new ir support legacy kernel instruction

* add scope prefix

* update

* update

* update

* update

* fix

* revert channel shuffl test

* polish code

* try to fix windows compile error

* polish code

* update

* update

* revert op test

* Support Prim Forward in New IR

* Fix test case

* polish code

* fix code

* polish format

* format code

* Provide opoperands(), opresults() methods for the Operation module
Signed-off-by: Njjyaoao <jjyaoao@126.com>

* Update test_ir_pybind.py

---------
Signed-off-by: Njjyaoao <jjyaoao@126.com>

* fix xpu

* change download dir

* fix dir

* fix dir

* roll back

* bakup

* code style check

* fix wrong path

* roll back

* update paddle2onnx

* update codestyle

* myStupidBug STREQUAL->EQUAL

* fix new ir sgd op bug

* fix bug

* fix bug

* update

* revert code

* [prim][newir] add basic framework for primitive

* support desctensor in new ir

* add vjp interface

* support vjp in new ir

* support vjp in new ir

* polish vjp interface

* fix stop_gradients set

* fix vjp dispatch

* add comment

* add vjp test for new ir

* add test for tanh vjp

* [prim][newir] add basic framework for primitive

* support desctensor in new ir

* support vjp in new ir

* support vjp in new ir

* polish vjp interface

* fix stop_gradients set

* fix vjp dispatch

* add comment

* add vjp test for new ir

* add test for tanh vjp

* add eager and static backend for warp lower level api

* support call_vjp pybind

* polish code and add test for vjp

* remove useless code

* polish code

* remove useless code

* support mean vjp

* add test for mean vjp and support has_vjp function

* fix call_vjp

* polish code

* add primitive ops set for backend

* add vjp test for tanh_

* fix inference CI

* fix inference ci

* modify fluid cmake

* remove useless deps

* add cmake

---------
Co-authored-by: Ncxxly <chenxx_id@163.com>
Co-authored-by: Nzhangbo9674 <zhangbo54@baidu.com>

* support new ir dy2st

* revert code

* skip test with stride

* chang import file

* add mask

* add backword

* add enforce info

* update scale

* integrate code

* update enforce

* add enforce eq

* add error type

* update enforce

* add test_flash_attention

* Polish codes and fix compiling errors.

* Set num_splits to 0 for flash-attn with tensor mask.

* Fix the compiling error for non flash-attn case.

---------
Co-authored-by: NLiu Yiqun <liuyiqun01@baidu.com>

* make tcp store a global instance

* fix windows compile error

* add attrs and dtype interface

* fix compile bugs

* fix some bugs

* fix windows bugs

* fix cudnn 8.7+ bug on cudnnConvolutionBiasActivationForward

* save_optimized_model_pass support tensorrt

* update

* update

* fix compile

* update

* fix ut timeout

* refactor codegen for cinn

* add to_string to some type which can't be += with string

* fix multi-thread bug caused by static var

* delete dead code and comment

* commit

* commit

---------
Co-authored-by: Nzhoukangkang <zhoukangkang@baidu.com>

* [xdoctest] reformat example code with google style in `paddle/tensor/math`

* preview, test=docs_preview

* scale, test=docs_preview

* stanh, test=docs_preview

* multiplex, test=docs_preview

* pow, test=docs_preview

* max, test=docs_preview

* others..., test=docs_preview

* update trunc example code, test=docs_preview