* Saving inference model for user defined quantization

* Saving inference model for user defined quantization

* add user defined func test=develop

* update test=develop

* update test=develop

* fix name conflicts test=develop

* add unittest test=develop

* change 2018 to 2020 test=develop

* add comment test=develop

* add comment for function test=develop

* fix details test=develop

* fix details test=develop
Co-authored-by: NLiufang Sang <slf12thuss@163.com>

test=release/1.8, test=document_fix

* Update sigmoid output from Y to out, test=develop (#24765)

* Collecting concat output threshold, test=develop (#24742)

* Add output threshold for ops that have several output activations, test=develop (#24726)

* [Fix bug] Init scale node in OutScaleForTrainingPass and enable test_quantization_scale_pass UT (#24393)

* Init scale node in OutScaleForTrainingPass, test=develop
* Enable test_quantization_scale, test=develop

* update local data preprocess doc

* update for 1.8 QAT

* update benchmark data
Co-authored-by: NWojciech Uss <wojciech.uss@intel.com>
test=release/1.8
test=document_fix

test=release/2.0

* QAT: support range-based quantization and scales from attribute

* added support for channelwise

test=release/2.0

* allow amp and recompute working together

Weight quantization support channel_wise_abs_max method to achieve higher accuracy (#23629) (#23937)

* Weight quantization support channel_wise_abs_max method to achieve higher accuracy

* Update for QAT INT8 MKL-DNN document, added info on VNNI in Windows, benchmark results added and updated

* add tdm sampler op

* fix compile bug

* fix compile bug

* fix compile bug

* fix compile bug

* test=develop, add tdm sampler unittest

* fix tdm sampler unittest

* fix input var name bug

* update tdm sampler unittest

* fix unittest

* fix unittest

* update tdm sampler unittest

* add tdm exe run unittest

* fix infershape

* test=develop, add doc

* test=develop, fix gcc8 compile bug & unittest bug

* test=develop, fix unittest

* test=develop, fix T one & zero

* test=develop, add unittest check

* test=develop, add doc smaple code & fix dype set

* test=develop, fix dtype

* test=develop, fix compile bug

* test=develop, fix unittest

* test=develop, fix unittest

* test=develop, check py3 unittest

* test=develop,fix unittest

* test=develop, fix py3&py2 unittest diff

* test=develop, fix sample code

* test=develop, fix sample code

* test=develop, fix sample code

* test=develop, fix error message

* Collect output scale for quantized op and fused op
* Post_training_quantizaion sets batch_generator to support lod tensor

* add tdm child op

* Post_training_quantizaion supports min_max methon

* Added an option to use external FP32 model in QAT comparison test

* fix basic gru lstm parameter attr bug; test=develop

* fix bias attr bug; test=develop

* add basic lstm gru name unitest; test=develop

* add partial_sum_op, test=develop

* modify the Paddle Error Message, test=develop

* modify the Paddle Error Message, test=develop

* modify the bug for python3, test=develop

* modify the ut for ci, test=develop

* mv to contrib, test=develop

* use check_variable_and_dtype, test=develop

* fix ci, test=develop

* fix conflict, test=dvelop

* add partial concat, test=develop

* fix the conflict, test=develop

* fix the error, test=develop

* rm SSE4, test=develop

* add partial_concat, test=develop

* fix the grids and blocks, test=develop

* fix the Paddle_Enforce, test=develop

* fix the doc of op, test=develop

* fix the doc, test=develop

* fix the doc of the op, test=develop

* replace -1 with None, test=develop

* Doc update with Ernie QAT INT8 benchmarking

test=develop

* fixes after review

test=develop

* remove ernie part, test=develop test=document_fix

* Fix model name for qatv2

test=develop test=document_fix

* Add Ernie data

test=develop test=document_fix

* update ERNIE benchmark with baidu QA results, test=develop test=document_fix
Co-authored-by: Nbingyanghuang <33643817+bingyanghuang@users.noreply.github.com>
Co-authored-by: NMichał Gallus <sand3r@interia.eu>

* a test for Ernie QAT INT8 accuracy check

test=develop

* Remove NLP comparison test to split PRs

test=develop

* Fix typo and tabs, delete commented lines

test=develop

* re-combine the 2 PRs, test=develop
Co-authored-by: NMichał Gallus <sand3r@interia.eu>
Co-authored-by: Nbingyanghuang <33643817+bingyanghuang@users.noreply.github.com>