1.Support Broadcast op
2.Support communication op as graph output
3.Optimize Communication op memory alocation
4.support hccl multi-group

Merge pull request !1188 from panyifeng/fine_tuning_mindspore_test_framework

Merge pull request !1170 from yangjie159/fix_memreuse_to_support_large_batchsize

Merge pull request !1192 from h.farahat/string_Tensor

Merge pull request !1186 from wenchunjiang/construct_kernel_graph

Merge pull request !972 from seatea/fix-cse-bug-for-random-effect

Merge pull request !1166 from wukesong/add-dy-lr

Merge pull request !1129 from zhaozhenlong/op/bounding-box-encoder

Merge pull request !1203 from changzherui/code516

Merge pull request !1176 from jiangjinsheng/issue_transpose

be optimized as it will generate different values each time.

Merge pull request !804 from huanghui/fix-confusionmulgrad-fusion-pass

Merge pull request !1195 from jiangjinsheng/issue_geswitch

Merge pull request !1172 from Chong/support_squeeze_and_reduce

Merge pull request !1199 from caifubi/fix-profiling-core-dump

Merge pull request !1100 from jinyaohui/context_opt_2

Merge pull request !1196 from ms_yan/concat_format

iou

NMSWithMask

larsupdate testcase

sgd testcase

Merge pull request !1184 from wangcong/master

Merge pull request !1138 from JoyLvliang/pynative-fix-topk-run-failed

kernel_graph from root func_graph

Merge pull request !1178 from zhouneng/add_vm_support_roialign

-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work

Merge pull request !1191 from ms_yan/map_column

Merge pull request !1061 from jiangzhiwen/dataset/flat_map

Merge pull request !1162 from lianliguang/using-device-dtype-to-create-transdata-kernel-build-info

Merge pull request !1120 from Kang/master

Merge pull request !1180 from YuJianfeng/master