* [paddle-TRT] support mark output

* [fix bug] hook function only call one in different predictor

* add api test

* fix op translator reshape type

* new ir support vector type place transfer

* add test case

* fix new ir bn grad bug

* add lu_unpack data check

* add error input api test

* add error type info

* add flags for cinn test

* rename DescTensor

* remove useless code

* modify code style

* modify code style

* modify code style

* fix op translator reshape type

* new ir support vector type place transfer

* add test case

* [WIP] Add mp_all_reduce asynchronize overlap.

* Fix some problems.

* Fix dw compute bug, and use a temporary solution to achieve overlap.

* Use fused_linear_param_grad_add to compute dw.

* Reformat ColumnParallel _overlap_linear. Use environment flags to
control following behaviors:
1. export Flags_mp_aysnc_allreduce=True to turn on mp async all_reduce
2. export Flags_skip_mp_c_identity=True to skip two c_identity operators
   in dygraph mode.
3. export Flags_fused_linear_param_grad_add to enable fused_linear_param_grad_add
   in ColumnParallel backward with mp async all_reduce.

* Polish code.

* Remove useless communication API.

* Fix some problems in mp_async_all_reduce and skip_c_identity.

* Add test cases.

* Remove environment variable Flags_fused_linear_param_grad_add in test case.

* Reset error threshold.

* Reset threshold in test case.

* Add useful log. Remove useless test cases.

* [NewIR] support c_broadcast

* add legacyOpList

* refine static op return val

* Fix Mac Timeout Test

* fix test

* fix

* Fix test

* Tesst

* Fix mac test

* fix inset get_parameter op bug

* fix bug: insert  only for parameters

* fix bug: wrong idx in vector

---------
Co-authored-by: Nzhangbo9674 <zhangbo54@baidu.com>

Added a graph data structure in units of ScheduleBlock and some necessary operations, such as finding upstream and downstream nodes, and performing operations in the DFS topological order.

Co-authored-by: Nxiongkun <xiongkun03@baidu.com>

* update

* update

* fix silu backward prim bug

* fix silu double grad prim

* [NewIR]Add CinnJitInstruction for interpreter

* fix windows compile error

runtime compiler api will only build special target if it is bind.

'--include-path' is not supported by hipcc and "-I/include/folder"
is better choice

fix ut:
        * device_code_test
        * test_code_generator
        * test_fusion_group_pass
        * test_fusion_group_op
Signed-off-by: Njiajuku <jiajuku12@163.com>

* [Fluid] Migrate c_embedding to PHI

* fix

* add python_api

* fix ut

* migrate xpu kernel

* fix windows compile error

* test=docs_preview

* test=docs_preview

* test=docs_preview

* test=docs_preview

* fix indent in math.py

* test=docs_preview

* test=docs_preview

* test=docs_preview

* test=docs_preview

---------
Co-authored-by: NSigureMo <sigure.qaq@gmail.com>

* add TrilAndTriuOpTranscriber for ir translator

* refine

* fix assert op pd to kernel pass bug

* refine

* refine

* [Approve]Modify inference size approve name list

* [NewIR]Refine shape dialect directory

* modify IR into ir

* fix cmake

* fix typo

* add range support in indexing

* add getitem ut case

* [prim][newir] add basic framework for primitive

* support desctensor in new ir

* add vjp interface

* support vjp in new ir

* support vjp in new ir

* polish vjp interface

* fix stop_gradients set

* fix vjp dispatch

* add comment

* add vjp test for new ir

* add test for tanh vjp

* [prim][newir] add basic framework for primitive

* support desctensor in new ir

* support vjp in new ir

* support vjp in new ir

* polish vjp interface

* fix stop_gradients set

* fix vjp dispatch

* add comment

* add vjp test for new ir

* add test for tanh vjp

* add eager and static backend for warp lower level api

* support call_vjp pybind

* polish code and add test for vjp

* remove useless code

* polish code

* remove useless code

* support mean vjp

* add test for mean vjp and support has_vjp function

* fix call_vjp

* polish code

* add primitive ops set for backend

* add vjp test for tanh_

* fix inference CI

* fix inference ci

* modify fluid cmake

* remove useless deps

* add cmake

* fix comment

* fix test

* polish code

* modify backward stop_gradients

* modify static_backend.cc

* support add and add_inplace vjp

* remove useless code

* remove useless code

* remove cout

* remove cout

* fix add_grad

* fix add test exe

---------
Co-authored-by: Ncxxly <chenxx_id@163.com>
Co-authored-by: Nzhangbo9674 <zhangbo54@baidu.com>

* remove if_simplify and rewrite block_simplify

* delete unused if_simplify

* fix: updated code examples.

* fix: updated blank lines.

* fix: updated code style

* fix: removed extra changes

* fix: refine detail

* add phi forward api gen impl

* add phi backward gen code

* polish api code gen impl

* polish code gen impl

* remove auto_paralel namespace

* add dygraph forward impl

* add for_auto_parallel cond

* fix code gen errors

* add dygraph backward impl

* resolve conflict with develop

* refactor dist api gen impl

* revert origin api gen impl

* replace template for override func

* fix dnnl marco error

* revert third_party change

* add with distributed marco

* Update grad_tensor_holder.cc details

* merge dist tensor constructor

* change test tensor to replicate

* fx typo

* resolve conflict with develop

* fix out dim error

* support new ir load combine

* update

* polish code

* remove print

* support c concat

* update

* polish code

* fix bug

* polish code

* fix compile bug

* polish code

* remove useless code

[xdoctest][task 108] Reformat example code with google style in python/paddle/optimizer/lbfgs.py (#56224)

* [xdoctest][task 108] test=docs_preview

* Apply suggestions from code review

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

* install python_library_into_ci_image

* install python libraries into image

* install python libraries into image

* install library into image