* fix calling bug of HybridParallelClipGrad

* fix bugs of HybridParallelClipGrad

* add unittest of pp with HybridParallelClipGrad

* fix bugs in mp_layers.py

* update

* fix bugs in pp_layers.py

* update

* support ClipGradByGlobalNorm in sharding

* support ClipGradByGlobalNorm in sharding

* test=allcase

* fix bugs in HybridParallelClipGrad of hybrid_parallel_optimizer

* update

* update

* fix raw optim

* pre-commit test file
Co-authored-by: Nsneaxiy <sneaxiy@126.com>

* fix raw optimizer gm

* update

* update ut

* support grad group

* fix single card condition

* sharding support dp

* sharding support mp

* sharding support pp

* add fleet api for program pass

* turn on apply pass for CI test

* fix disable fuse_all_optimizer bug

* try to test ci

* fix CI

* fill unspecified op role

* fix fuse_allreduce

* add ut to improve coverage

* remove useless change

* improve c++ coverage

* follow some comments

* test ir pass pipeline

* update doc

* reduce ut time again

[Hybrid Performance] Move the cast op of AMP which cast fp32 param to fp16 param to the optimizer (#34965)

* cache core.ops, test=develop

* refine, test=develop

* add amp support for pp

* add amp untest

* dygraph sharding

* update unitest hybrid_parallel_communicate_group