* skip ReplaceAllReduceOp in GraphtoBlock when nccl_ctxs_ is nullptr

* update ut

* test_dist_allreduce_op failed

* fix test_dist_allreduce_op

* add ut

* fix nccl cpu compile

* fix

* [CodeStyle] remove all future import

* revert test_error.py

* restore future import in example code

* [MLU] fix sync_bn of mlu and add unittests

* [MLU] remove redunant code of pytest

* use tempfile to place temporary files

* update

* revert test_communicator

* fix test_dist_base

* use yapf to format all python file

* yapf exclude two unittests file for they rely on writing and reading file, and format will break them

* disable diff_py_file because too many diff files cause command following failed

* support diff batch for sparse of eagerreducer

* fix

* support process group in dp with fleet api

* update

* fix uts

* update

* add uts for EagerReducer

* add more uts

* fix bugs

* fix bugs

* modify

* modify uts

* fix bugs

* update

* update

* update

* solve conflicts and merge

* add some other uts

* modify time of uts

* update

* update

* update

* remove uts of resnet

* Added HCCL backend support in dynamic graph mode

* fix segmentation fault

* add ut

* In cpu parallel using gloo, add various length support for SelectedRows

* fix bug

* fix bugs

* fix by code review

* remove timeout

* mv recv to head, test=develop

* del py2 code2

* fix test timeout

* fix find_unused_parameters default value

* support control flow

* supoort sync_parameters_buffers

* fix the bug of sparse embedding

* update, test=develop

* remove data parallel scale loss & apply collective_grads

* move apply in minimize

* fix failed unittests

* add gloo initializer, test=develop

* add gloo initializer, test=develop

paddle.distributed.fleet supports dynamic graph execution.

* add dygraph parallel run interface

* polish implement & unified env property name

* add print config arg

* refactor init_parallel_env function

* Compatible with multiprocessing and launch modes

* set default trainer start port

* support run in python 2

* polish python2 support code

* remove python2 support

* refine launch import

* polish dome design details

* refactor api implemention & path

* use new method _set_expected_place

* add spawn unittest framework & mnist test

* add more unittests & doc

* fix unittest failed

* polish english doc

* self review and polish details

* refactor code by reviewer's comments

* fix unittest failed

* fix parallel_env unittest

* fix several typos

* fix error introduced when fixing typos

* add unpublic note for start_processes

* polish details by xiaoguang's comment

* verify correctly when spawn nprocs=-1

* refactor spawn & init_parallel_env design

* polish doc details

* open spawn unittests

* try to fix doc compile error

* try to fix unknown doc format error

* add skip unittest when not gpu

* add retry for prefetch

* Revert "Fix/sync barrier (#25016)"

This reverts commit be6a315f.

* reopen dist UT, test=develop

* remove fl UT, test=develop

* disable distributed UT temporary，enable it soon, test=develop