add two paddle-2.0 apis: paddle.static.io.save_inference_model and paddle.static.io.load_inference_model (#28606)

* add two apis: paddle.static.io.save_inference_model and paddle.static.io.load_inference_mode, which are campatible with paddle.fluid.io.save_inference_model and paddle.fluid.io.load_inference_model respectively.

* add unittest for new save_inference_model and load_inference_model. test=develop

* enhance doc. test=develop

* add paddle.enable_static() to test_inference_model_io.py. test=develop

* add base hook classes and reduce hook impl

* fix constructor typo

* polish comment format

* refactor baisc hook class design

* polish design details

test=develop

* add debuging code

* change seed & add debug message

* support user-defined quant and preprocess

* add matmtl_v2 to amp list

* support dygraph

Fix a bug that used in PaddleGAN model which used `isinstance` in a for loop

* adapt pad const

* fix comment and rm fluid import

* rm stdout

* fix note

* add unittest and check unittest for windows

* fix lstm OP compile error on windows

* fix pool exclusive and delete disable_static, test=develop

* fix pool1d  exclusive, test=develop

* fix output dtyp inconsistent with input

* refine code

Co-authored-by: Nyaoxuefeng6 <yaoxuefeng@baidu.com>

fix the gradient bug for the topk v2 

* add WeightedRandomSampler. test=develop

* Add checkpoint to quantize

* Change bfloat16 option

* add mkldnn inplace op version test

* update mkldnn_inplace fuse pass

* update the inplace test

* fix test_multinomial

* fix test_multinomial add 0 prob

* DataLoader support not auto collate batch. test=develop

PaddleSeg uses tuple as parameter of transpose in dygraph code:
https://github.com/PaddlePaddle/PaddleSeg/blob/release/v0.7.0/dygraph/paddleseg/models/danet.py#L152

However, in dy2stat, static code doesn't support the perm as a tuple. This PR fixed it.

* Fix gradients with ignore_idx in softmax_with_cross_entropy.
test=develop

* Fix gradients with ignore_idx in softmax_with_cross_entropy on cpu.
Remove softmax_with_cross_entropy from op_threshold_white_list.
test=develop

* Fix test_softmax_cross_entropy_op.py.
test=develop

Fix no_grad setting in AdamW.
test=develop

* Support squeezed label as input in paddle.metric.Accuracy
* Revert cifar and fix UT