* support new ir primitive operator in static operants

* support more vjp code gen

* support more vjp code gen

* support more vjp code gen

* use code gen

* fix operants codegen

* support more vjp code gen

* Fix ci build error

* set FLAGS_tensor_operants_mode to static in generated_vjp for testing

* fix bugs

* change the order of ops_name of divide_grad

* replace FLAGS_enable_new_ir_in_executor by FLAGS_enable_new_ir_api in codegen and test_vjp_prim

---------
Co-authored-by: NCharles-hit <wanghao107@baidu.com>
Co-authored-by: N0x45f <wangzhen45@baidu.com>

* add symbolicDimProduct & symbolicDimMgr without method shape_constraint related.

* split ddim in phi, add a target ddim, used by pd_type.

* add pd_type.cc to ir_shape CMakeLists.

* add dimOp, tieProductEqualOp. access constraint_func in SymbolTable.

* put DenseTensorType into builtin_type.

* add constraint related Mgr func.

* move to out assert.

* add_n and combine support selected rows

* fix bug

* fix bug

* [NewIR]Support Build(GroupOps) in NewIRCompiler and Add UT

* fix unittest

* sep group

* add test

* test ok

* polish

* test cmake script generated

* add sep group

* format

* polish

* polish

* fix static_build for pp

* add mannual_event to support streams across progs

* revert static_build.sh

* fix coverage-ci

* modify the method to name events

* change code according to review

* fix addn infermeta

* fix rule bug

* [WIP] Support std::vector<phi::Tensor> input and output for DistTensor.
Concat forward and backward are verified.

* Polish code for new dist tensor implementation.

* Fix bug of DistTensor upgrade. Add support functions for std::vector<Tensor> -> std::vector<Tensor>.

* Add support for DistTensor type of std::vector<phi::Tensor> as input or output of operators.
Following testcases are passed.
1. concat: std::vector<phi::Tensor> -> phi::Tensor
2. unbind: phi::Tensor -> std::vector<phi::Tensor>
3. broadcast_tensors: std::vector<phi::Tensor> -> std::vector<phi::Tensor>

* Polish code. Remove useless comments.

* Add update_loss_scaling in skip_op_lists.

* Polish code.

* replace amp.use_pure_fp16 with amp.dtype and amp.level

* old api still use use_pure_fp16

* test_fuse_adamw_pass still use use_pure_fp16

* add test case tuning recompute with amp(float16,o2)

* reset new test case properties TIMEOUT 60

* set smaller value of batch_size and batch_num

* deepcopy dist_context fix _rename_input problem

* fix loss name after cast

* set tuning.enable=True and use engine._tune()

* restore some changes in _rename_input()/_rename_output()

* add self.amp_dtype for _cast_loss() in auto_parallel_amp.py

* fix insert op index in _cast_loss()

* add rotate_half in fused_rope

* add position_ids in fused_rope

* modified examples about fused_rope

* add set_device in examples

* remove has_structed_kerenl and has_fluid_kernel

* add test_fused_layernorm_op to STATIC_BUILD_TESTS list

* open static_build flag

* remove distributed_fused_lamb_init from StaticBuildBlackList

* use initialized replacing IsInitialized

* recover codes

* delete useless codes

* close the flag

* add num_splist for flash_attn_bwd and FlashAttnUnpaddedGradKernel

* Add assertTrue

* Update submodule to a specific commit

* disable strided split

* add code

* add code

* refine code

* add code

* fix bug

* fix bug

* fix bug

* add code

* add ut

* polish code

* fix bug

* refine code

* fix bug

* refine code

* fix bug

* refine code

* fix bug

* refine code

* fix bug

* refine code

* add code

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* refine code

* Modify MarkTrtEngineOutputs API

Change FlattenLoops in the elementwise schedule to Fuse

* fix contiguous

* add reference of lbfgs

* add reference of lbfgs

* new ir op test v1.0

* fix new ir optest bug1.0

* modify two testcase bug

* add new ir white list & pass test_mean_op.py

* rename white list

* add new_ir_guard

* new ir sum op test all pass

* rename backward.grad as ir_backward.grad

* check place for new ir

* fix test_build_model env bug

* fix test_prim_program backward bug

* change backward to ir_backward in check_appr

* add check_new_ir flag for mkldnn

* clean

---------
Co-authored-by: Nwangruting <wangruting@baidu.com>

* polish code of pass and executor

* update ut

* [NewIR]Refine CINN Dilact directory

* fix conflict

* fix deps

* fix unittest deps

* link C++ tests to libpaddle.so except windows

* fix compile kill-9 bug

* fix compile kill-9 bug

* fix compile kill-9 bug

* fix compile kill-9 bug

* Fix attr type error like concat axis

* Fix None input error

* Fix intermediate output

* support vjp code gen

---------
Co-authored-by: N0x45f <wangzhen45@baidu.com>

* support index_select op

* index_sample in cpu

* support index_sample in gpu

* change data_transform

* fix api gen and use skip_transform in yaml

* [NewIR]Part-2.1 Refactor NewIRCompiler to support Group Ops

* fix gflags link error

* fix include ir_printer.h

* fix unittest

* fix conflict

* fix flags

* fix comment

* add test for legacy_op

* add test for legacy_op

* add test

* change test legacy op : pd.c_concat

* fix codestyle

* add legacy kernel op test

* Update ir_kernel_dialect_pass_test.cc

* Update ir_kernel_dialect_pass_test.cc

* Update ir_kernel_dialect_pass_test.cc

* enable dy2st newIR test

* fix 2023-08-29

* fix_2

* add complex support for isclose

* add complex test for isclose

* fix template complie issue

* fix cuda compilation error

* fix type typo

* fix error for complex's abs

* add complex dtype into input

* fix ut

* add reference of lbfgs

* add reference of lbfgs

* new ir op test v1.0

* fix new ir optest bug1.0

* modify two testcase bug

* add new ir white list & pass test_mean_op.py

* rename white list

* add new_ir_guard

* rename backward.grad as ir_backward.grad

* check place for new ir

* fix test_build_model env bug

* fix test_prim_program backward bug

* change backward to ir_backward in check_appr

---------
Co-authored-by: Nwangruting <wangruting@baidu.com>