* refactor mp.

* update setup.py.

* update mp_layers.py for compatibility.

* add documents for mp_layers.py

* update init.py

* update collective.py.

* update.

* update mp_ops.py

* update.

* update code style.

* update code style.

* trim trailing whitespace

* fix `.cmake-format.py`

* revert npu ut changes, avoid npu ci error

* reconstruct_of_fleet_api

* update

* [OpAttr]Support VarDesc* and vector<VarDesc*> in Attribute

* add unittest for inference predictor

* use yapf to format all python file

* yapf exclude two unittests file for they rely on writing and reading file, and format will break them

* disable diff_py_file because too many diff files cause command following failed

* fix utest

* fix time

* refactor eager flags

* fix flags error when we switch from eager to dygraph

* fix ci problem

* fix ci

* fix ci

* merge develop and fix code style

* merge develop and fix code style

* fix op test error

* fix op test error

* fix op test error

* fix op test error

* fix op test error

* merge develop

* fix calling bug of HybridParallelClipGrad

* fix bugs of HybridParallelClipGrad

* add unittest of pp with HybridParallelClipGrad

* fix bugs in mp_layers.py

* update

* fix bugs in pp_layers.py

* update

* sharding support dp

* sharding support mp

* sharding support pp

* add recompute for pp

* add recompute offload

* add recompute partition

* add save/load for pipelineparallel

* add save/load

* add layer segment

* add segement for transformer

* add utest

* add pplayer

* add sharedlayerdesc

* add parallel_cross_entropy

* add grad for crossentropy

* fix cross entropy

* fix c_split bug

* fix utest

* add c_embedding for tensorparallel

* fix precision of mp

* fix bug of seed

* fix dp

* print group

* update, test=develop

* fix amp bug

* fix name of wordsize

* fix model parallel

* rm parallel_help.py

* add embedding

* add pipeline layer