* add fused_allreduce_gradients_with_group

* add scale

* fix ci

* update config

* re-blacken python code

* temporarily disable date and diff_py_file

* skip a format

* [CodeStyle][F401] remove unused import in python/paddle/distributed

* remove pass

* empty commit

* Fix ValueError: list.remove(x): x not in list for meta_optimizer_names.

Fix ValueError: list.remove(x): x not in list for meta_optimizer_names.

* Fix split import.

Fix split import.

* add noqa after meta_optimizers in factory

* restort collective ops

* expand `import *`

* add noqa after required imports

* try to fix APIs without core.ops

* Revert "try to fix APIs without core.ops"

This reverts commit 6172beaf601e84bf61f2490c12c4739f0edaa5eb.

* fix an increment

* empty commit

* add noqa after required imports

* expand `import *`, fix ci error
Co-authored-by: NShuangchi He <34329208+Yulv-git@users.noreply.github.com>

* fix bugs of mp

* fix bugs of mp

* update

* update

* fix bug

uniform logger manager in FleetAPI.
hidde API under distributed/utils which users don't need.

* reconstruct_of_fleet_api

* update

* fix bugs of reducer

* update

* update

* use yapf to format all python file

* yapf exclude two unittests file for they rely on writing and reading file, and format will break them

* disable diff_py_file because too many diff files cause command following failed

* remove unrequired ut cases

* update

* fix bugs

* update

* fix bug of check_inf

* fix allreduce

* Add solutions to PyLayer which is unsupported in DataParallel

* modify note format for parallel.py

* modify docs of dataparallel

* add docs of dp with pylayer

* modify docs format

* modify example format

* change example of dp with pylayer

* add unittest for dp with pylayer

* modify ut

* merge latest codes

* update

* modify for CI-Coverage

* modify text-indent

* dygraph sharding

* update unitest hybrid_parallel_communicate_group

* fix precision of mp

* fix bug of seed

* fix dp

* print group

* fix model parallel

* rm parallel_help.py

* add embedding

* add clip/check

* add amp & clip grad in dygraph

* add logging

* support dp & mp