* Fatal bug fix for hapi.eval

When multiple metrics are specified in hapi for eval, the output samples of the model are incorrectly truncated, resulting in inaccurate metric calculations

* fix codestyle

* [enhancement] Implement tensor.cpu() in static graph

* [enhancement] Implement tensor.cpu() in static graph

* [dy2static] add unitest cases for tensor.cpu()

* [dy2static] add unitest cases for tensor.cpu() - run only on paddle compiled with cuda mode

* [dy2static]Refine the format of the api-doc for Variable.cpu().

* Improve GC for pipeline parallel

* Delete print

* update

* update cache

* fix compile error

* open

* update

* new ir remove fetch list

* fix pattern rewrite bug

* try to remove constant fold

* revert code

* add pattern rewrite test flag

* fix multi fetch

* remove usless code

* new ir support legacy kernel instraction

* new ir support legacy kernel instruction

* add scope prefix

* update

* update

* update

* update

* fix

* revert channel shuffl test

* polish code

* try to fix windows compile error

* polish code

* update

* update

* revert op test

* Support Prim Forward in New IR

* Fix test case

* polish code

* fix code

* polish format

* format code

* Provide opoperands(), opresults() methods for the Operation module
Signed-off-by: Njjyaoao <jjyaoao@126.com>

* Update test_ir_pybind.py

---------
Signed-off-by: Njjyaoao <jjyaoao@126.com>

* fix xpu

* change download dir

* fix dir

* fix dir

* roll back

* bakup

* code style check

* fix wrong path

* roll back

* update paddle2onnx

* update codestyle

* myStupidBug STREQUAL->EQUAL

* fix new ir sgd op bug

* fix bug

* fix bug

* update

* revert code

* [prim][newir] add basic framework for primitive

* support desctensor in new ir

* add vjp interface

* support vjp in new ir

* support vjp in new ir

* polish vjp interface

* fix stop_gradients set

* fix vjp dispatch

* add comment

* add vjp test for new ir

* add test for tanh vjp

* [prim][newir] add basic framework for primitive

* support desctensor in new ir

* support vjp in new ir

* support vjp in new ir

* polish vjp interface

* fix stop_gradients set

* fix vjp dispatch

* add comment

* add vjp test for new ir

* add test for tanh vjp

* add eager and static backend for warp lower level api

* support call_vjp pybind

* polish code and add test for vjp

* remove useless code

* polish code

* remove useless code

* support mean vjp

* add test for mean vjp and support has_vjp function

* fix call_vjp

* polish code

* add primitive ops set for backend

* add vjp test for tanh_

* fix inference CI

* fix inference ci

* modify fluid cmake

* remove useless deps

* add cmake

---------
Co-authored-by: Ncxxly <chenxx_id@163.com>
Co-authored-by: Nzhangbo9674 <zhangbo54@baidu.com>

* support new ir dy2st

* revert code

* skip test with stride

* chang import file

* add mask

* add backword

* add enforce info

* update scale

* integrate code

* update enforce

* add enforce eq

* add error type

* update enforce

* add test_flash_attention

* Polish codes and fix compiling errors.

* Set num_splits to 0 for flash-attn with tensor mask.

* Fix the compiling error for non flash-attn case.

---------
Co-authored-by: NLiu Yiqun <liuyiqun01@baidu.com>

* make tcp store a global instance

* fix windows compile error

* add attrs and dtype interface

* fix compile bugs

* fix some bugs

* fix windows bugs

* fix cudnn 8.7+ bug on cudnnConvolutionBiasActivationForward

* save_optimized_model_pass support tensorrt

* update

* update

* fix compile

* update

* fix ut timeout

* refactor codegen for cinn

* add to_string to some type which can't be += with string

* fix multi-thread bug caused by static var

* delete dead code and comment

* commit

* commit

---------
Co-authored-by: Nzhoukangkang <zhoukangkang@baidu.com>

* [xdoctest] reformat example code with google style in `paddle/tensor/math`

* preview, test=docs_preview

* scale, test=docs_preview

* stanh, test=docs_preview

* multiplex, test=docs_preview

* pow, test=docs_preview

* max, test=docs_preview

* others..., test=docs_preview

* update trunc example code, test=docs_preview

* add paddle-symbolic-trace to paddle

* add symoblic trace

* delete swp

* support Layer in symbolic trace

* fix test-symbolic-trace, make symbolic trace return a StaticFunction

* template the error message

* fix some unittest

* Modify the execution mode of test

* Modify the module name

* add dy2static unittest decorator

* change some unittest files by @ast_only_test

* fix unittest.

* test-symbolic-trace

* update test_write_python_container.py

* update

* fix test_param_parse.py

* add submodule and ln -sf in cmakefile

* update

* update

* fix some ast only errors

* update

* Polish ut

* fix unittests

* update

* update

* fix unittests

* update

* test warning ast only

* update

* Ast only some uts

* Fix unitests

* test_error ast only

* update

* update

* Support build_strategy for sot

* update

* import sot as a third party module

* update

* update

* Polish code

* update

* update

* update

* update

* update

* remove old fluid api and use paddle.nn.relu instead

* fix

* comment the print of ast code

* add try-finally block

* fix dy2static stop-gradient bugs

* fix code

* remove unused submodule and minor codestyle fix

* fix

* fix cast error

* fix interpolate meets int64 in static model

* add evalframe support for py311

* fix

* fix err

* switch ENABLE_FALL_BACK=False

* fix

* Fix CI for some unittest

* add ENABLE_SOT

* remove setup.py dependences

---------
Co-authored-by: NNotHaozi <zhangmenghao@baidu.com>
Co-authored-by: Nfeifei-111 <2364819892@qq.com>
Co-authored-by: N0x45f <wangzhen45@baidu.com>
Co-authored-by: NSigureMo <sigure.qaq@gmail.com>

* Test Del paddle_bfloat

* Del paddle_bfloat test

* inplace tol

* code style

Update Save/Load Interface to 2.0