Merge pull request !3338 from zhoufeng/debug-op-overflow

Merge pull request !3334 from ms_yan/device_que_param

Merge pull request !3007 from john_tzanakakis/master_ms1

Merge pull request !3343 from fary86/fix_float_max_value_compare

Merge pull request !3333 from YuJianfeng/master

Merge pull request !3311 from lirongzhen1/master

Merge pull request !3301 from Giancarlo/pm_commutative_ops

Signed-off-by: Nzhoufeng <zhoufeng54@huawei.com>

Merge pull request !3285 from linqingke/gpu_ops

Merge pull request !3318 from liyong126/fix_save_doc

Merge pull request !3331 from liuxiao93/Add-BNInference-opInfo

Merge pull request !3328 from shenwei41/sw_master

Merge pull request !3289 from ZhangQinghua/master

Merge pull request !3342 from cathwong/ckw_c_api_skip

Additonal Authors: Adel Shafiei, Harshvardhan Gupta

Merge pull request !3294 from nsyca/removal_pass

Merge pull request !3303 from ZiruiWu/fix_vocab_validator

Merge pull request !3336 from vlne-v1/remove_loop_can_unroll

Merge pull request !3337 from zhangbuxue/add_check_for_implict_conversion_when_scalar_is_string

Merge pull request !3332 from jiangzhiwen/fix_csv_shard

Merge pull request !3309 from lianliguang/master

Merge pull request !3319 from gengdongjie/master

!3335 scripts updation for bert to debug failures of pre-training processing when warmup step was set to be zero
Merge pull request !3335 from shibeiji/bert_script_debug

Merge pull request !3330 from lichen/autoparallel_support_dataset_in_gpu

Merge pull request !3327 from wangnan39/fix_bug_in_sparse_proximal_adam_optim

Merge pull request !3295 from wangqiuliang/support-mix-precision

Merge pull request !3266 from zhaoting/ResNext50