Merge pull request !3153 from jinyaohui/all_reduce

Merge pull request !3156 from liuxiao93/ApplyMomentumD-ApplyMoment-GE

Merge pull request !3098 from wangnan39/sparse_optimizer_adapter_indexedslice

Merge pull request !3159 from wangqiuliang/replace-unsafe-function

Merge pull request !3135 from VectorSL/cast2

Merge pull request !3036 from jinyaohui/master

Merge pull request !3080 from vlne-v1/remove-redundant-phi

Merge pull request !3142 from caojian05/ms_master_dev

Merge pull request !3130 from vlne-v1/quant_op_depthwise

Merge pull request !3152 from yao_yf/reshape_ut_remove

Merge pull request !3148 from xiefangqi/cpp-api-windows-fix

Merge pull request !2989 from kisnwang/two-step-reduce-sparse-gradient

Merge pull request !2973 from luoyang/update

Merge pull request !3123 from hanjun996/master

Merge pull request !2876 from lirongzhen1/master

Merge pull request !3118 from jjfeing/master

Merge pull request !3140 from hexia/add_serving_option

Merge pull request !3097 from wangqiuliang/replace-unsafe-function

Removed log header

Merge pull request !3131 from zhangbuxue/change_shape_and_dtype_of_tensor_from_interface_to_attr

Merge pull request !3144 from nhussain/dataset_check

Merge pull request !3143 from TinaMengtingZhang/dataset-op-ut-mnist

Merge pull request !3101 from islam_amin/autocontrast_op

Merge pull request !3077 from ava/invert

Merge pull request !3138 from ZiruiWu/random_tensor_ops

Merge pull request !3137 from cathwong/ckw_dataset_ut_cleanup7

Merge pull request !3088 from lianliguang/primitive-decoupling