Merge pull request !3169 from zhoufeng/xiu-ba-ge

Merge pull request !3115 from YuJianfeng/master

Merge pull request !3115 from YuJianfeng/master

Merge pull request !3153 from jinyaohui/all_reduce

Signed-off-by: Nzhoufeng <zhoufeng54@huawei.com>

Merge pull request !3156 from liuxiao93/ApplyMomentumD-ApplyMoment-GE

Merge pull request !3098 from wangnan39/sparse_optimizer_adapter_indexedslice

Merge pull request !3159 from wangqiuliang/replace-unsafe-function

Merge pull request !3135 from VectorSL/cast2

Merge pull request !3036 from jinyaohui/master

Merge pull request !3080 from vlne-v1/remove-redundant-phi

Merge pull request !3142 from caojian05/ms_master_dev

Merge pull request !3130 from vlne-v1/quant_op_depthwise

Merge pull request !3152 from yao_yf/reshape_ut_remove

Merge pull request !3148 from xiefangqi/cpp-api-windows-fix

Merge pull request !2989 from kisnwang/two-step-reduce-sparse-gradient

Merge pull request !2973 from luoyang/update

Merge pull request !3123 from hanjun996/master

Merge pull request !2876 from lirongzhen1/master

Merge pull request !3118 from jjfeing/master

Merge pull request !3140 from hexia/add_serving_option

Merge pull request !3097 from wangqiuliang/replace-unsafe-function

Removed log header

Merge pull request !3131 from zhangbuxue/change_shape_and_dtype_of_tensor_from_interface_to_attr

Merge pull request !3144 from nhussain/dataset_check

Merge pull request !3143 from TinaMengtingZhang/dataset-op-ut-mnist

Merge pull request !3101 from islam_amin/autocontrast_op