* Doc update with Ernie QAT INT8 benchmarking

test=develop

* fixes after review

test=develop

* remove ernie part, test=develop test=document_fix

* Fix model name for qatv2

test=develop test=document_fix

* Add Ernie data

test=develop test=document_fix

* update ERNIE benchmark with baidu QA results, test=develop test=document_fix
Co-authored-by: Nbingyanghuang <33643817+bingyanghuang@users.noreply.github.com>
Co-authored-by: NMichał Gallus <sand3r@interia.eu>

* a test for Ernie QAT INT8 accuracy check

test=develop

* Remove NLP comparison test to split PRs

test=develop

* Fix typo and tabs, delete commented lines

test=develop

* re-combine the 2 PRs, test=develop
Co-authored-by: NMichał Gallus <sand3r@interia.eu>
Co-authored-by: Nbingyanghuang <33643817+bingyanghuang@users.noreply.github.com>

* post_training_quantization support set bits, test=develop

* up, test=develop

* support weight quantization in post_training_quanzitaion, test=develop
* add test for weight quantization, test=develop

* add mul and matmul quantization, test=develop
* add test for matmul, test=develop

test=develop

* fix post training quantization bug of memory constrained, support the input be different, test=develop

* fix ci bug for deleting data files, test=develop

* update, test=develop

* update benchmark for int8v2, QAT1, QAT2 accuracy and performance
test=document_fix

* change according to reviews
test=develop test=document_fix

* improve some descriptions and some models
test=develop test=document_fix

* update models benchmark data
test=develop test=document_fix

* update int8v2 and qat2 performance
test=develop test=document_fix

* add ut for comparing FP32 and QAT INT8

* add save qat transformed model python script
test=develop

* updated

* added missing file

* add "with_label"
test=develop

* performance benchmark as unit test
test=develop

* change names of unnecessary thing

* Change CMakeList.txt for model downloading and UT
test=develop

* change names of functions and params for more readable code
test=develop

* Change PADDLE_ENFORCE messages
test=develop

* fix indent problems
test=develop

* indent problems
test=develop

* add global value getter setter, test=develop

* fix error messages, test=develop

* support set model_filename and params_filename in post_training_quantization, test=develop

* Support  more ops in post training quantization, and save the output scale in quantized op.
* Update docs in post training quantization and qat 

test=develop

* Fix bug for inserting add_quant_dequant_op to same variable repetitively in add_quant_dequant_pass, test=develop

* add post training quantization, test=develop
* specify the quantizable op type, test=develop

test=develop

* move pool2d to add_quant_dequant_pass, test=develop

* fix fuse_reduce_op quantization bug test=develop

* close fuse_all_reduce_ops in PaddleSlim, test=develop

* Leave fake quantization around mul

* Replace Fake with Real Quantized Mul

* Gather all scales from fake_quantize_ops

* Enable uint8 in conv_relu tensors

* Disable int8 mul and restore fake mul

* Fix buf for running QAT on VGG16 and 19

* fix next_tokens of controller