* add <with_grad_semantic> in OpInputInfo to represent whether an input of OP has grad semantics

* add support for check OP's input grad semantic by comparing fwd_op inputs and bwd_op outputs

* add pybind interface to support checking OP's inputs grad semantic in python-level

* add test

* fix bugs

* fix bugs in op_gen

* fix bugs in op_gen

* add test for multiply_op

* fix bugs in codestype

* fix bugs in codestype

* [XPU] add squeeze_excitation_block_xpu op&pass to optimize ppocr_v3_det model test=kunlun

* fix

* fix Codestype

* remove xpu name

* fix setvalue dtype error when using dy2st and amp O2

* add one test

* remove test share_buffer since win/linux have different number

* fix bug

* fix bug

* div passed v1.0

* IrChange->IrGuard & optimize static input dtype

* clean

* remove IrChange and optimize IrGuard

* support new ir primitive operator in static operants

* support more vjp code gen

* support more vjp code gen

* support more vjp code gen

* use code gen

* fix operants codegen

* support more vjp code gen

* Fix ci build error

* set FLAGS_tensor_operants_mode to static in generated_vjp for testing

* fix bugs

* change the order of ops_name of divide_grad

* replace FLAGS_enable_new_ir_in_executor by FLAGS_enable_new_ir_api in codegen and test_vjp_prim

---------
Co-authored-by: NCharles-hit <wanghao107@baidu.com>
Co-authored-by: N0x45f <wangzhen45@baidu.com>

* add symbolicDimProduct & symbolicDimMgr without method shape_constraint related.

* split ddim in phi, add a target ddim, used by pd_type.

* add pd_type.cc to ir_shape CMakeLists.

* add dimOp, tieProductEqualOp. access constraint_func in SymbolTable.

* put DenseTensorType into builtin_type.

* add constraint related Mgr func.

* move to out assert.

* add meta tensor

* refine code

* fix bug

* fix bug

* update

* update

* update

* update

* update

* add_n and combine support selected rows

* fix bug

* fix bug

* [NewIR]Support Build(GroupOps) in NewIRCompiler and Add UT

* fix unittest

* 更改相关文件

* Update ir.py

* 恢复相关文件

* Update ir.py

* Delete python/paddle/incubate/optimizer/modelaverage.py

* Delete modelaverage.py

* 尝试恢复文件

* Revert "尝试恢复文件"

This reverts commit 8a263cfd4642614a48a30f648c61fc801331e550.

* Revert "恢复相关文件"

This reverts commit 24249b8191fb3901681ffa9d0e1ad79ef43454de.

* Revert "Revert "尝试恢复文件""

This reverts commit 1b833d623770a851f202c68fff51e77723121a9d.

* Revert "Revert "Revert "尝试恢复文件"""

This reverts commit 64b3a816d1f0fef5ee9100480b8354749005a463.

* Revert "Delete python/paddle/incubate/optimizer/modelaverage.py"

This reverts commit 61986296bf48f7b9bef878bed6890c5dc2971481.

* Revert "更改相关文件"

This reverts commit a5ba675a948534401247b779d6a0fba0581d0628.

* Apply suggestions from code review

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

[xdoctest][task 268] reformat example code with google style in `/incubate/nn/layer/fused_transformer.py` (#56965)

* [Doctest]fix No.268, test=docs_preview

* Apply suggestions from code review

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

[xdoctest][task 79] reformat example code with google style in  `python/paddle/nn/functional/loss.py` (#56901)

* [Doctest] fix No.79, test=docs_preview

* Apply suggestions from code review

* fix gpu

* fix

* fix

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

* test=docs_preview

* test=docs_preview

* test=docs_preview

* test=docs_preview

* test=docs_preview

* test=docs_preview

* fix

* test=docs_preview

* test=docs_preview

* fix

* move stmts under imports

---------
Co-authored-by: NSigureMo <sigure.qaq@gmail.com>

* sep group

* add test

* test ok

* polish

* test cmake script generated

* add sep group

* format

* polish

* polish

* fix static_build for pp

* add mannual_event to support streams across progs

* revert static_build.sh

* fix coverage-ci

* modify the method to name events

* change code according to review

* move to phi

* fix

* fix type

* fix addn infermeta

* fix rule bug

* [XPU] remove range check for ignore index

* add a log

* [WIP] Support std::vector<phi::Tensor> input and output for DistTensor.
Concat forward and backward are verified.

* Polish code for new dist tensor implementation.

* Fix bug of DistTensor upgrade. Add support functions for std::vector<Tensor> -> std::vector<Tensor>.

* Add support for DistTensor type of std::vector<phi::Tensor> as input or output of operators.
Following testcases are passed.
1. concat: std::vector<phi::Tensor> -> phi::Tensor
2. unbind: phi::Tensor -> std::vector<phi::Tensor>
3. broadcast_tensors: std::vector<phi::Tensor> -> std::vector<phi::Tensor>

* Polish code. Remove useless comments.

* Add update_loss_scaling in skip_op_lists.

* Polish code.

* [clang-tidy] replenish cppcoreguidelines-narrowing-conversions

* fix

* fix

* replace amp.use_pure_fp16 with amp.dtype and amp.level

* old api still use use_pure_fp16

* test_fuse_adamw_pass still use use_pure_fp16

* add test case tuning recompute with amp(float16,o2)

* reset new test case properties TIMEOUT 60

* set smaller value of batch_size and batch_num

* deepcopy dist_context fix _rename_input problem

* fix loss name after cast

* set tuning.enable=True and use engine._tune()

* restore some changes in _rename_input()/_rename_output()

* add self.amp_dtype for _cast_loss() in auto_parallel_amp.py

* fix insert op index in _cast_loss()