* refine the old code

* support moving_average_abs_max and per_channel_abs_max

* Add moving_average_abs_max_scale op

* Convert the test program

* add random and prevent deadlock

* fix safe bug of scatter/scatter_nd

* dygraph sharding

* update unitest hybrid_parallel_communicate_group

* add get and set for Grad_scaler

* refine some API name and comments

* refine API name and comments

* refine some comments

* added matmul_v2 bf16/fp32 FWD kernel

added matmul_v2 bf16/fp32 FWD kernel

* added formatting

* removed some tests due to timeout in CI

* refactored tests

* merged tests classes into one file

* minor change

* removed test guard for CUDA

* remove skipIf

* changes after review

* formated one file

* minor change

* added skipping UT in CUDA place

* refine temp_scope_vec logic

* polish partial_program

* fix fake var

* add stop_gradient in spec

* fix fake_var

* fix unittest

* support set_device for NPU.

* minor update doc and add more unit test.

* fix cpu/gpu check approve

* test=coverage;test=notest

* test=coverage;test=notest

* del

* scale_matmul_fuse_pass_init

* enhance scale_matmul_fuse_pass

* change scale_matmul_fuse_pass unittest

* del py2 code3

* test=notest;test=coverage

* del

* fix

* add retry in pull sparse

* retry

test=develop.