* fix calling bug of HybridParallelClipGrad

* fix bugs of HybridParallelClipGrad

* add unittest of pp with HybridParallelClipGrad

* fix bugs in mp_layers.py

* update

* fix bugs in pp_layers.py

* update

* sharding support dp

* sharding support mp

* sharding support pp

* add recompute for pp

* add recompute offload

* add recompute partition

* add save/load for pipelineparallel

* add save/load

* add layer segment

* add segement for transformer

* add utest

* add pplayer

* add sharedlayerdesc

* add parallel_cross_entropy

* add grad for crossentropy

* fix cross entropy

* fix c_split bug

* fix utest

* add c_embedding for tensorparallel

* fix precision of mp

* fix bug of seed

* fix dp

* print group

* update, test=develop

* fix amp bug

* fix name of wordsize

* fix model parallel

* rm parallel_help.py

* add embedding

* add pipeline layer