* make params_grads order same bewteen dynamic and static mode

* revert inplace clip

* use sorted attribute to control

* tiny fix

* fix find loss_grad_op

* remove the optimizer base and learning rate base

* fix bug

* fix bug

* open

* update

* Update autoparallel DistributedDataLoader

* add places for engine.dataloder()

* simple reaplce

* for debug

* fix bugs

* fix some bugs

* del fill_constant_batch_size_like

* Support nvprof for auto parallel

* Fix CI errors

* Fix CI errors

* remove allreduce before c_allgather

* update reshard insert_fill_constant_op func

* insert_fill_constant_op add shape arg

* add skip_gc_vars for 1f1b schedule mode

* add pp_degree and pp_stage

* base rule

* add sharidng merge

* add sharidng axis merge

* define unified data class for inferencing dist_attr

* test wrap DistTensorSpec in dygraph mode

* matmul main logic done

* define unified data class for inferencing dist_attr

---------
Co-authored-by: NYichen Zhang <zhangyichen03@baidu.com>

* auto parallel support pipeline scheduler with standalone executor

* rm check_fetch

* update cmakelist and flags env

* rm set micro batch id

* rm import

* update utils func

* raise error when merge tensor for return_numpy is False

* fix _pipeline_opt

* fix unittest

* bump ruff to 0.0.271 and update config

* exclude third_party

* bump ruff to 0.0.272

* refine config

* eager call all2all to avoid p2p hang in lazy init

* update

* [AutoParallel] add 1F1B

* rm amp

* [AutoParallel] update while control_flow with pipeline

* update process group instantiate

* fix micro_bsz for reshard

* update api for micro batch size

* add strategy for dp optimization

* [Auto Parallel] Reorganize the fold structure

* [Auto Parallel] Fix some import errors