* skip_layernorm_op done

* add unittest

* slice op convertor support trt < 6

* skip_layernorm only work in ernie

* disable ut test_parallel_executor_fetch_isolated_var,test=document_fix

* test for limiting ut exec time as 15S

* fix an error caused by cannot find ut

* fix some error

* can not find test_transformer

* fix error caused by ut not run in windows

* fix error caused by Compiler Options

* fix error caused by setting timeout value as 15 in python/paddle/tests/CMakeLists.txt

* setting timeout value to 120s for old ut

* add the timeout value setting

* fix error caused by ut only run in coverage_ci

* add analyzer_transformer_profile_tester

* fix some error

* fix some error

* fix error with inference option

* fix error with inference option setting as ON_INFER

* add some ut to set timeout

* modified some option

* fix error

* fix some timeout error

* fix error

* fix error

* fix timeout for test_analyzer_bfloat16_resnet50

* fix error

* setting timeout properity for some ut

* first pr for new ut timeout as 15S

* fp16 result ok

* change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS

* auto detect special slice op converter for ernie with trt oss

* ernie oss only support fp16

* fix special_slice_plugin serialize bug

* matmul in tensorrt ok

* ernie unittest ok

* add matmul tensorrt unittest

* remove demo code

* enable infer model running CAPI

* output size should bigger than 0

* [buf fix]:fix unittest test_activation_op error

* split long-time unittests to smaller ones

* rename some unittests

fix judge cache file of inference api more accurate

* fix trt_dynamic_shape_ernie_deserialize_test

* support when opt cache dir does not exist

* Fix the lookup_table_v2 failed on GRU mkldnn kernel issue
test=develop

* fix according to reviews, removed x_num_col_dims
test=develop

* update gru model. change according to reviews
test=develop

* change according to reviews
test=develop

Fix problem that target name already exists when there isn't model data cache, test=develop (#27142)

* Modify data download function, and support unittests of inference APIs on windows, test=develop

* The import error compatible with py2 and py3, and fix unittests problems of inference APIs on Windows, test=develop

* Add mkldnn bfloat16 option to C-API

* Add test for bfloat16 gpu

* Change coverage test

* Repair capi_gpu test

* add stack_op to CMakeLists

* add dim=3 support for scale op

* add trt stack op, test=develop

* remove debug message

* add stack plugin serialize

* remove slice, scale op, will add later

* enhence error message

* revise trt ernie test to conver the stack op CI testi, test=develop

* add stack op serialization

* fix test shape after adding stack op

* remove slice op, will add after implementing serialization

* roll back to min_graph=5 to avoid using slice op

* fix scale op output layer

* implement stack op createPlugin

* use workspace and move the defination to .cu

* move stack plugin creator definition to .cu, test=develop

This reverts commit 02083bda.

* support trt dynamic shape int8

* add unittest

* add support for sigmoid; adapt to trt6+ api

* refine paddle inference api
Co-authored-by: Nnhzlx <nhzlx.dragon@gmail.com>

* Add mkldnn bfloat16 option to C-API

* Add test for bfloat16 gpu

* Change coverage test

* Add the option to execute unit tests only at night

* set ut nightly label for 3 cases.

* Add laxical GRU unit test

performance works

* Get model accuracy

* model and data name to be confirmed
test=develop

* update model name and output format
test=develop

* update according to reviews
test=develop

* add accuracy check

* accuracy check between native and analysis
test=develop

* fix a reading bug, fix gru passes sequence
test=develop

* fix passes sequence
test=develop

* develop dynamic shape serilization

* add test param for gelu

* fix bugs

* delete redundant comments

* debug

* fix conflict. test=develop

* fix bug. test=develop

* add trt dynamic shape serialized support

* fix ernie serialized bug
test=develop

* fix codestyle
test=develop

* fix bug
test=develop

* fix bug.test=develop

* modify cmakelist test=develop

* fix bug
test=develop

* fix error message.  test=develop

* fix trt register plugin based on pr#25003

* add trt dynload

* fix deserialization bug of not finding plugin registration

* refine code style

* recover engine key in tensorrt_subgraph_pass

* for ci coverage

* add unittest for deserialization
Co-authored-by: Nhaozech <chenhaoze94@gmail.com>

* fix windows test
test=develop

* fix ci
test=develop