* Small corrections.

* Fix lr for bf16.

* Revert some changes.

* copy found_inf to cpu in advance to improve performance

* add npu test

* add npu test

* refine code

* refine memcpy op

* fix adam

* pass found_inf to adam

* add unittest

* fix bug

* refine unittest

* change unit test's directory

* disable unittest on cpu

* add clear_float_status op

* refine infershape

* fix typo

* refine check_finite_and_scale

* refine code

* cache core.ops, test=develop

* refine, test=develop

* fix undef var

* fix undef var

* PTQ save quantized model

* Wrap simulated layer

* post process the inference model

* opt dygraph python API, test=develop

* Fix unbind bug in manipulation.py

* reduce sum op default fp32, add into amp black list

* reduce_sum default fp32 can avoid return inf when the sum value large than 65504

* refine ptq according comments
* reuse the module to calculate kl threshold

* Save all scales to target ops
* Move quant layers to paddle.nn.quant

* refine the old code

* support moving_average_abs_max and per_channel_abs_max

* Add moving_average_abs_max_scale op

* Convert the test program

* dygraph post training quantization

* refine the ptq config

* refine ptq quantizer

* Combine amp and qat
* add unit test

* del py2 code2

* fix test timeout