* fix raw optimizer gm

* update

* update ut

* support grad group

* fix single card condition

* sharding support dp

* sharding support mp

* sharding support pp

* add fleet api for program pass

* turn on apply pass for CI test

* fix disable fuse_all_optimizer bug

* try to test ci

* fix CI

* fill unspecified op role

* fix fuse_allreduce

* add ut to improve coverage

* remove useless change

* improve c++ coverage

* follow some comments

* test ir pass pipeline

* update doc

* reduce ut time again

[Hybrid Performance] Move the cast op of AMP which cast fp32 param to fp16 param to the optimizer (#34965)

* cache core.ops, test=develop

* refine, test=develop

* add amp support for pp

* add amp untest

* dygraph sharding

* update unitest hybrid_parallel_communicate_group

* update, test=develop

* fix pipeline

* fix mp pp dp

* fix utest of hybrid parallel

* add utest for tuple