Co-authored-by: Nbaiyangfan <baiyangfan@baidu.com>

Add 3d Parallelism
Co-authored-by: NWangXi <wangxi16@baidu.com>
Co-authored-by: NJZ-LIANG <jianzhongliang10@gmail.com>
Co-authored-by: Nroot <root@yq01-sys-hic-k8s-v100-box-a225-0562.yq01.baidu.com>

add ascend unittest

Ascendrc

Fix reshape on GE graph

support parsing ascend rank table file

Destroy session first.

Add paddle ascend distribution training supported

Ascendrc add converted op : [range/equal/range/uniform_random/expand/squeeze], fix cast op bug  (#30797)

Ascendrc add converted op : [range/equal/range/uniform_random/expand/squeeze], fix cast op bug 

Merge ascend_optimizer and ascend_parser.

code style

[Feature] Build parser to support distributed training

Pass device_ids info from launch to trainer

Build praser for Hcom* operators

Add distribution supported

* test=develop, fix fleet.metrics(mse, rmse, mae)

Co-authored-by: NseiriosPlus <tangwei12@baidu.com>

* test=develop, add distributed_infer

* rename sendrecv.proto to namespace paddle.distributed

* split ps with distributed

* add save tensor support
Co-authored-by: NseiriosPlus <tangwei12@baidu.com>

* add tensor table

* update, test=develop

* update, test=develop

* oneps (3/4)
Co-authored-by: NMrChengmo <cmchengmo@163.com>
Co-authored-by: Nmalin10 <malin10@baidu.com>
Co-authored-by: Nchengmo <chengmo@baidu.com>

* fix fleet for multi-stream

* fix memcpy for ncclid

* use sync to solve move operation

* Sharding add hybrid-dp feature

* update sharding in distributed_strategy

* update sharding unitest

* revise code format for sharding

* add tensor_indices in AssignGroupBySize

* add rebuild group in reducer

* update, test=develop

* fix doc, test=document_fix