* support create shard dist tesnor

* support non-zero shard to replicated

* change reshard signature

* support new ir load combine

* update

* polish code

* remove print

* update

* update

* update

* polish code

* fix bug

* polish code

* fix compile bug

* fix bug

* revert code

* remove useless code

* polish code

* fix pylayer py39 mem leak

* LGTM

* [Doctest]fix No.125-137, test=docs_preview

* [Doctest]fix No.125-137, test=docs_preview

* fix codestyle

* resolve conversation

* change Example

* fix example format...

* fix my stupid fp16

* fix codestyple

* [Doctest]fix No.293-296, test=docs_preview

* empty commit

* code style

* empty commit

* fix timeout

* fix timeout

* modify sum with divide net bug mutablesttribute

* delete prin

* pulish backward

* pulish backward

* fix test bugs

* delete code

* auto mixed precision inference support white list

* update

* update

* update

* move down identity_op_clean_pass

* fix code style

* add_bias_and_simplify_mmha

* [Doctest]fix No.144-149, test=docs_preview

* fix timeout

* Update parallel_with_gloo.py

* xdoc

* Update input.py

* Update input.py

* Update gather.py

* Update broadcast.py

* Update batch_isend_irecv.py

* Update all_to_all.py

* Update all_reduce.py

* Update all_gather.py

* rollback

* Apply suggestions from code review

* Apply suggestions from code review

* Apply suggestions from code review

* fix: refine code examples

* fix: refine detail

* refactor: refine detail

* refactor: refine detail

* fix: refine code style.

* Update python/paddle/incubate/autograd/functional.py

---------
Co-authored-by: NNyakku Shigure <sigure.qaq@gmail.com>

* modify feed_data for dataloader in pipline parallel mode

* add pre-commit

* remove read op, use feed op

* fix validate batch_size

* tiny fix

* support catch EOFException

* fix conflict

* fix conflict

* fix executor if cond

---------
Co-authored-by: Frida-a <2624653516@qq.com>

* update

* fix comile error

* generate .parsed.yaml file from .yaml file

* code style fix

* bug fix

* remove backward op

* add generator/ folder

* add .gitignore

* fix bug : mkdir for .parsed.yaml file

* try to fix bug:add dir

* fix small bug in reshape spmd rule

* small fix in unit test

* bind python interface for pass manager

* add ut

* revert unused change

* Gen all Apis

* Gen python c apis

* Add empty file

* Fix cast data type

* Fix None dtype

* fix inplace with set_parameter

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* refine code

* refine code

* fix bug

* refine op_gem

* fix bug

* stride flag open

* shard_tensor support static graph

* add comments

* add dy2static ut

* use property in c++ side

* modify sum with divide net bug mutablesttribute

* delete prin