* [Auto Parallel] Suppport different dataloaders

* [Auto Parallel] Add num_shards config for dataset

* [Auto Parallel] Unify the logger and outputs of Engine API

* [Auto Parallel] Fix the bugs of to_static

* [Auto Parallel] Adjust the test_to_static.py

* [Auto Parallel] Add the prepare API and replace __call__ with run

* [Auto Parallel] Improve the private implementations of Engine

* [Auto Parallel] Set capacity of dataloader for opt tuning

* [Auto Parallel] [WIP] Change the fine-grained API

* [Auto Parallel] Improve APIs to support different user cases

* [Auto Parallel] Add removed config

* [Auto Parallel] Add imports

* [Auto Parallel] Fix bugs for to_static

* [Auto Parallel] Remove unnecessary imports

* [Zero-Dim] support input 0D Tensor for unary api

* fix CI

* [CodeStyle][F401] remove unused imports in unittests/dygraph_to_static

* [CodeStyle][F401] remove unused imports in unittests/ir

* add noqa after required imports

* [CodeStyle][F401] remove unused imports in unittests/mkldnn

* fix some increment

* [CodeStyle] use built-in `open` instead of `io.open`

* revert flake8 config changes

[CodeStyle] remove compat module (long_type, int_type, get_exception_message, floor_division) (#46686)

* fix crop shape None error

* add test case

* fix testcase

* fix import

* fix testcase

* fix codestyle

* add fp16 data type for set_value

* cancel flip modification

* add fp16 dtype support for set_value

* Update README.md

* Update README.md

* Fix E713: convert 'not ... in' to 'not in'

* Update README.md

* Update README.md

* Fix F632: replace 'is', 'is not' with ==, != respectively

* Update README.md

* Update README.md

* Fix F601: only keep the last key among the same names

* Update README.md

* Update README.md

* Fix F541 by converting f-string to normal strings

* Update README.md

* Update README.md

* Fix F402 by changing the name of loop variable

* Change variable name
Change variable name 'temp_tensor' to 'var' to avoid confusion, as var
also appears in the same file.

* add yaml entry for rnn and rrnn_grad, move infershape function for rnn_grad to phi infer meta

* WIP: move rnn kernrl to phi

* Change the code generation to avoid converting from intializer list to tuple of heterogeneous types.
This is only triggered when an api has intermediate outputs, and the result of the outputs are of heterogeneous types.

* fix the bug that when none in a vector of tensors requires gradient, the conversion to InferShapeContext to InferMetaContext (a.k.a. BuildInferMetaContext) produces errorous results.

* fix ci bugs

* fix ci bugs

* fix ci bugs

* modify code according comment
Co-authored-by: Nchenfeiyu <chenfeiyu@baidu.com>

* [CodeStyle][F401] remove unused imports in unittests/distributed_passes,tokenizer,sequence

* add noqa after required imports

* [Auto Parallel] Unify the logger and outputs of Engine API

* [Auto Parallel] Fix the bugs of to_static

* [Auto Parallel] Adjust the test_to_static.py

make fused_multi_transformer support dynamically set the cache_kvs' shape and support input prefix_caches. (#46777)

* make fused_multi_transformer support dynamically set the cache_kvs' shape and support input prefix_caches.