* einsum support 0d tensor.
1. support 0d tensor in multi-operands.
2. add 9 unittests for einsum 0d tensor.

* override NVIDIA_TF32_OVERRIDE to avoid accuracy problem in 11.2 and 11.8

* update pypi doc

* update pypi doc

* update pypi doc

* empty commit, re-trigger all ci
Co-authored-by: NSigureMo <sigure.qaq@gmail.com>

* [AutoParallel] adapt for clip

* fix unittest

* enable_static

* fix dist_fill_constant_batch_size_like

* fix process_mesh.shape

* update cond of modifying shape_list

* rm legacy fluid part4

* rm non_static_mode

* minor change

* modify initializer

* rm legacy for initializer

* fix dataloader test

This PR increased the delta in unit test for CUDA 11.8. The reason of this fix:
(1) It seems CUDA 11.8 has higher delta in accuracy result. Our other targets for seresnext under parallel executor have already added delta such as CPU, all reduce test cases, so we did same for GPU base case with CUDA 11.8
(2) A new executor is under developing in PaddlePaddle team, so the unit test for old executor can be relaxed.

* delete old dygraph pylayer

* fix CINN should add float16.h may install bug

* reupdate setuppy support float16

* add only if float16.h file exists

* fix run_setup problem

* test

* fix fold for large bs

* fix fold for large bs

This reverts commit e1e8bf72.

* fix input order

* add unittest

* update cmakelist

* [AutoParallel] quantization pass support export

* support subgraph

* move_presist_var_to_global_block

* update unittest

* fix ci-coverage

* fix codestyle

* fix fake_dequantize_op

* remove unused var

* fix ci error and aprroval error

* add unittest for fp16 in test_dequant_linear

* replace mutable data

* fix unittest in non-cuda-core

* fix unittest
Co-authored-by: Ncarryyu <569782149@qq.com>
Co-authored-by: Nwufeisheng <wfs1997@163.com>

* delete old dygraph sharding

* cinn use interpretercore

* fix bug

* fix compile bug

* fix scope bug

* refine code

* refine code by comment

* refine code by comment

* Support priority scheduling for standalone executor

* Add CPU test

* rm in_legacy_dygraph nn part1

* rm non_static_mode

* modify rrelu

* delete _in_legacy_dygraph

* feat: broadcast_object_list & scatter_object_list

* chore: update ut conf

* get_backend & is_available

* docs: update requirements

* fix: resolve conflicts
Co-authored-by: NLiYuRio <liyuruijx@163.com>

* rm legacy unittest part5

* add custom op

* migrate shaple sgd, split,sign xpu kernels to phi, test=kunlun

* fix dlrm throughput problem, test=kunlun

* add index sample fp16 support

* remove fluid APIs in distributed_strategy.py and role_maker.py

* Revert "remove fluid APIs in distributed_strategy.py and role_maker.py"

This reverts commit 223bbee990d3bf69e252fc3c0f19e3873550a264.

* move load_inference_model to distributed

* fix origin develop codes diff

* move _endpoints_replacement

* delete line

* reset line

* add unittest case of load_inference_model

* fix unittest

* fix unittest

* fix coverage

* fix coverage

* revert concat and change concat to stack

* let stack kernel support int8, uint8 and bool type

* [Auto Parallel] Rename methods of ProcessMesh

* [Auto Parallel] Impl the python process_mesh by the c++ one

* [Auto Parallel] Add some minor modifications

* [Auto Parallel] Rename some methods

* [Auto Parallel] Remove unnecessary codes

* [Auto Parallel] Add back some removed files

* [Auto Parallel] Fix bugs

* [Auto Parallel] Fix a bug

* Update process_mesh.cc

* [Auto Parallel] Fix a bug

* remove loss.py

* fix __init__.py

* Memory search for stream analyzer

* Shrink redundant waiters

* Enable identity_scale_op_clean_pass by default

* IdentityScaleOpCleanPass assert_var_not_persistable