* add cache for send_recv

* add eval_batch for pipeline

* add eval batch for pipelineparallel

* add style code

[Hybrid Performance] Move the cast op of AMP which cast fp32 param to fp16 param to the optimizer (#34965)

[CPU-PSLIB] Add consistency insepection of use_var_list and data_generator data, test=develop (#34463)

* fix bug of py36 import

* add recompute for pp

* add recompute offload

* add recompute partition

* add save/load for pipelineparallel

* add save/load

* fix bug of p2p for partial

* fix error

* add layer segment

* add segement for transformer

* add utest

* support 1f1b for pipeline

* add utest

* add send_partial/recv_partial

* support amp for pp

* fix logger

* add trainer desc config to distributed strategy

* code style modified

* fix force kill for elastic

* cache core.ops, test=develop

* refine, test=develop

* add scatter-gather opt

* fix topo for pp

* rename function

* kill process by group

* pipeline adaptive for heterps;test=develop
* fix finalize hang;test=develop
* add is_compiled_with_heterps for dataset;test=develop
* fix hashtable core when pass ins_num=0;test=develop

* add amp support for pp

* add amp untest