* rm legacy

* clear in_legacy

* fix tracer

* auto parallel bf16

* rm legacy dygraph part7

* rm non_static_mode

* modify

* modify

* add static test

* set static for lstm_cudnn test

* reset tracer

* reset varbase

* fix

* fusedAttenGrad_noGrad

* code style fix

* add ut

* remove unnecessary log

* rm legacy nn part2

* rm _non_static_mode

* modify

* modify unpool test

* modify unpool test

* modify loss

* keep legacy for layer_norm

remove fluid.contrib.fused_elemwise_activation, sequence_topk_avg_pooling, var_conv_2d, match_matrix_tensor and tree_conv (#49331)

* add skip run

* alloc minimum memory

* skip check_size in Alloc

* skip check_size in Alloc

* skip check_size in Alloc

* fix cases when tensor is initialized or empty

* alloc empty output for place info

* add test

* increase timeout

* format code

* skip cpu

* add cudnn_deterministic

* fit for hostAlloc

* follow comments

* change check_size to fake_alloc

* einsum support 0d tensor.
1. support 0d tensor in multi-operands.
2. add 9 unittests for einsum 0d tensor.

* override NVIDIA_TF32_OVERRIDE to avoid accuracy problem in 11.2 and 11.8

* [AutoParallel] adapt for clip

* fix unittest

* enable_static

* fix dist_fill_constant_batch_size_like

* fix process_mesh.shape

* update cond of modifying shape_list

This PR increased the delta in unit test for CUDA 11.8. The reason of this fix:
(1) It seems CUDA 11.8 has higher delta in accuracy result. Our other targets for seresnext under parallel executor have already added delta such as CPU, all reduce test cases, so we did same for GPU base case with CUDA 11.8
(2) A new executor is under developing in PaddlePaddle team, so the unit test for old executor can be relaxed.

* delete old dygraph pylayer

* fix fold for large bs

* fix fold for large bs

* fix input order

* add unittest

* update cmakelist

* [AutoParallel] quantization pass support export

* support subgraph

* move_presist_var_to_global_block

* update unittest

* fix ci-coverage

* fix codestyle

* fix fake_dequantize_op

* remove unused var

* fix ci error and aprroval error

* add unittest for fp16 in test_dequant_linear

* replace mutable data

* fix unittest in non-cuda-core

* fix unittest
Co-authored-by: Ncarryyu <569782149@qq.com>
Co-authored-by: Nwufeisheng <wfs1997@163.com>

* delete old dygraph sharding

* Support priority scheduling for standalone executor

* Add CPU test

* delete _in_legacy_dygraph

* feat: broadcast_object_list & scatter_object_list

* chore: update ut conf

* get_backend & is_available

* docs: update requirements

* fix: resolve conflicts
Co-authored-by: NLiYuRio <liyuruijx@163.com>

* rm legacy unittest part5

* add custom op

* add index sample fp16 support

* remove fluid APIs in distributed_strategy.py and role_maker.py

* Revert "remove fluid APIs in distributed_strategy.py and role_maker.py"

This reverts commit 223bbee990d3bf69e252fc3c0f19e3873550a264.

* move load_inference_model to distributed

* fix origin develop codes diff

* move _endpoints_replacement

* delete line

* reset line

* add unittest case of load_inference_model

* fix unittest

* fix unittest

* fix coverage

* fix coverage

* [Auto Parallel] Rename methods of ProcessMesh

* [Auto Parallel] Impl the python process_mesh by the c++ one

* [Auto Parallel] Add some minor modifications

* [Auto Parallel] Rename some methods

* [Auto Parallel] Remove unnecessary codes

* [Auto Parallel] Add back some removed files

* [Auto Parallel] Fix bugs

* [Auto Parallel] Fix a bug

* Update process_mesh.cc

* [Auto Parallel] Fix a bug

* fix matmul double and triple grad

* remove some comment

* add matmul_double_grad unit test

* fix matmul triple grad

* fix dot triple grad and add unit test

* modify codestyle

* fix dot_grad

* refactor dot triple grad

* disable some unit test

* fix unit test

* fix unit test in double grad

* rm paddle.fluid.contrib.layers.BasicLSTMUnit basic_lstm BasicGRUUnit basic_gru

* rm dependency in __init__.py

* rm eager guard test

* retain grad for xpu test

* add warp transducer code

* [eager] use CPUAllocator directly

* modify pstring sizeof 48 default

* rm CPU test for NaiveBestFitAllocator

* fix Mac ci compile errors

* use UNUSED to state unused_obj

* mv UNUSED statement to allocator_facade.cc

* fix roi_align

* fix yolov3 test case

* recover original code

* recover original code

* fix trt roi_align test
Co-authored-by: Njerrywgz <jerrywgz@126.com>

* delete distribute old dygraph test cast

* Fix bug of reduce_sum op. When input.numel() > INT32_MAX, its result
is wrong.

* Remove climits.

* Clean Fluid APIs in python/paddle/fluid/layers/nn.py,
migrate spectral_norm and row_conv APIs, and remove ont_hot.
Including following files:
1. python/paddle/fluid/layers/nn.py
2. python/paddle/fluid/tests/unittests/collective/fleet/parallel_dygraph_transformer.py
3. python/paddle/fluid/tests/unittests/dist_transformer.py
4. python/paddle/fluid/tests/unittests/dygraph_to_static/transformer_dygraph_model.py
5. python/paddle/fluid/tests/unittests/ipu/test_one_hot_op_ipu.py
6. python/paddle/fluid/tests/unittests/test_imperative_auto_prune.py
7. python/paddle/fluid/tests/unittests/test_imperative_load_static_param.py
8. python/paddle/fluid/tests/unittests/test_layers.py
9. python/paddle/fluid/tests/unittests/test_one_hot_op.py
10. python/paddle/fluid/tests/unittests/test_row_conv_op.py
11. python/paddle/fluid/tests/unittests/test_runtime_and_compiletime_exception.py
12. python/paddle/fluid/tests/unittests/test_spectral_norm_op.py
13. python/paddle/static/nn/__init__.py
14. python/paddle/static/nn/common.py

* Polish code.

* Fix some bugs.

* Remove useless unittest.

* Fix some bug.

* Polish example code.

* Fix some bugs.

* Fix some bugs.

* rm unittests eager guard tests part21 sum_op2tensor_zero

* modify tensor hook test

* rm assert for type promotion

* review

* remove unittests eager guard tests part4 concat2custom_grad

* modify conv2d&3d test

* fix a bug in mem_allocated

* valueError->indexError for cross_entropy_loss test

* reset max_alloc_size