* Modify data download function, and support unittests of inference APIs on windows, test=develop

* The import error compatible with py2 and py3, and fix unittests problems of inference APIs on Windows, test=develop

* Add mkldnn bfloat16 option to C-API

* Add test for bfloat16 gpu

* Change coverage test

* Repair capi_gpu test

* add stack_op to CMakeLists

* add dim=3 support for scale op

* add trt stack op, test=develop

* remove debug message

* add stack plugin serialize

* remove slice, scale op, will add later

* enhence error message

* revise trt ernie test to conver the stack op CI testi, test=develop

* add stack op serialization

* fix test shape after adding stack op

* remove slice op, will add after implementing serialization

* roll back to min_graph=5 to avoid using slice op

* fix scale op output layer

* implement stack op createPlugin

* use workspace and move the defination to .cu

* move stack plugin creator definition to .cu, test=develop

This reverts commit 02083bda.

* support trt dynamic shape int8

* add unittest

* add support for sigmoid; adapt to trt6+ api

* refine paddle inference api
Co-authored-by: Nnhzlx <nhzlx.dragon@gmail.com>

* Add mkldnn bfloat16 option to C-API

* Add test for bfloat16 gpu

* Change coverage test

* Add the option to execute unit tests only at night

* set ut nightly label for 3 cases.

* Fix the cmake-function named inference_download_and_uncompress with Windows, test=develop

* Fix some problems when remove limit of unittests on Windows, test=develop

* Using URL to download file instead of DOWNLOAD_COMMAND. test=develop

* Add laxical GRU unit test

performance works

* Get model accuracy

* model and data name to be confirmed
test=develop

* update model name and output format
test=develop

* update according to reviews
test=develop

* add accuracy check

* accuracy check between native and analysis
test=develop

* fix a reading bug, fix gru passes sequence
test=develop

* fix passes sequence
test=develop

* develop dynamic shape serilization

* add test param for gelu

* fix bugs

* delete redundant comments

* debug

* fix conflict. test=develop

* fix bug. test=develop

* add trt dynamic shape serialized support

* fix ernie serialized bug
test=develop

* fix codestyle
test=develop

* fix bug
test=develop

* fix bug.test=develop

* modify cmakelist test=develop

* fix bug
test=develop

* fix error message.  test=develop

* fix trt register plugin based on pr#25003

* add trt dynload

* fix deserialization bug of not finding plugin registration

* refine code style

* recover engine key in tensorrt_subgraph_pass

* for ci coverage

* add unittest for deserialization
Co-authored-by: Nhaozech <chenhaoze94@gmail.com>

* fix windows test
test=develop

* fix ci
test=develop

* add api to clear intemediate tensors in analysis predictor. test=develop

* add python api. test=develop

test=develop

test=develop

* Paddle-TensorRT support slim QAT. test=develop

* add comments. test=develop

* use RenameInput instead of ResetInputs. test=develop

* add SetCommandLineOption

* add the print_FLAGS function

* remove the test demo

* modify the location of macro

* add the 'WITH_STATIC_LIB' option on windows

* modify the macro of PD_INFER_DECL

* modify the the fuction name

* modify the unittest

* modify the code style

test=develop

test=develop

* add new macro BOOST_GET_SAFELY & unittests, test=develop

* add different macro type, test=develop

* fix get macro type in executor, test=develop

* four macro part change backup

* using one macro for all case, test=develop

* revert attribute change, test=develop

* change to three func to solve gcc4.8 bug, test=develop

* polish some details, test=develop

* add UT for mkldnn_cache_capacity

test=develop

* fix comparison of integer expressions of different signedness

test=develop

* update the analysis predictor, test=develop

* update the unit test, test=develop

* no priority set before the inferface determined, test=develop

* interface name generalization, test=develop

* update local data preprocess doc

* update for 2.0 QAT

test=develop

test=document_fix

* update benchmark data

test=develop

test=document_fix
Co-authored-by: NWojciech Uss <wojciech.uss@intel.com>

* refine ernie trt dynamic shape support
1. add slice op converter
2. add emb eltwise layernorm fp16 support
test=develop

* fix dynamic shape test ut
test=develop

* fix comments.
test=develop

* fix comments
test=develop

* Support LoDTEnsorArray in fetch op

test=develop

* Support LoDTensorArray in fetch

test=develop

* Support LoDTensorArray in fetch

test=develop

* Support LoDTensorArray in fetch

test=develop

* Support LoDTensorArray in fetch

test=develop

* Support LoDTensorArray in fetch

test=develop

* Support LoDTensorArray in fetch

test=develop

* Support LoDTensorArray in fetch

test=develop

* Support LoDTensorArray in fetch

test=develop

* Support LoDTensorArray in fetch

test=develop

* add local data preprocess support for imagenet
test=develop

* add local data2bin tests
test=develop

* locally two tests passed
test=develop

* change according to reviews
test=develop

* add elementwise pool2d, prelu, shuffle channel
test=develop

* add scale and refine concat eltwise conveter
test=develop

* refine elementwise converter
test=develop

* refine ut test and enforce error.
test=develop

* modify const cast
test=develop