* refine structure for cuda and rocm

* update

* update

* update

* update

* support data_format='NHWC' for prelu channel mode

* matmul_convert_int8

* matmul_convert_int8

* matmulconvert_int8

* Matmul_int8_convert: tensor*tensor

* Matmul_int8_convert: tensor*tensor

* Matmul_int8_convert: tensor*tensor

* modify code about fp16 of dcnv2 trt

* fix_nearest

* fix_nearest

* fix_nearest

* fix_nearest

* change api for support trt8

* fix:change api

* add dcnv2 plugin

* disable padding if dynamic shape

* add parentheses

* correct

* fix

* remove const

* add nearest_interp_v2 trt plugin

* pool fix

* comments

* enhance yolobox plugin

* add mish trt plugin, compile & install success, run error. test=develop
* modify code according to review
* add TRT_NOEXCEPT for mish trt plugin
* add unittest for mish trt plugin
* remove unnecessary check of mish in op_teller.cc
* fix some problem of trt8
* add check and modify unittest while converting mish to trt plugin
Co-authored-by: Ndengkaipeng <dengkaipeng@baidu.com>

* add pool2d convert test

* modify error

* modify error

* modify error

* modify error

* modify error

* modify error

* add multihead_matmul trt converter test case

* move attribute check to op_teller

* support nnadapter and ascend310

* modify code

* add anchor_generator convert test

* add gelu convert test

* add conv2d convert test

* modify anchor_operator convert test

* modify conv2d test

* modify con2d convert test

* modify conv2d convert test

* modify conv2d convert test

* modify conv2d test

* fix WITH_PYTHON compile error

* modify test file

* modify test file

* modify test file

* modify test file

* modify test file

* modify test file

* modify test file

* modify test file
Co-authored-by: Nxiaoxiaohehe001 <hiteezsf@163.com>
Co-authored-by: Njiweibo <jiweibo@baidu.com>

* fix gather

* fix

* add_split_op

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_split_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* add_transpose_teller

* conv3d

* remove const_cast

* modify ut

* disable dynamic shape for trt6.0

* remove trt5

* update ernie int8

* fix_fc_reshape_convert

* fix

* tile op

* more uts

* disable tile if trt6.0

* typo

* fix timeout issue

* opteller

* opteller remove duplicate code

* comments.	test=document_fix

* modify PADDLE_ENFORCE.

* fix reduce_mean issue

* reduce_mean supported. test=allcase

* ut. test=allcase

* test=develop

* ut.test=allcase

* correct name. test=allcase

* correct UT. test=allcase

* correct UT.test=develop

* remove op

* UT

* add convert

* fix timeout issue

* more uts

* more ut

* correct ut

* add trt LT version helper

* upgrade PluginTensorRT to IPluginV2Ext

* trt plugin factory is not usable in IPluginV2

* upgrade add plugin api to use IPluginV2

* remove IPlugin register and adapt getSerializeSize(), serialize()

* adapt IPluginV2Layer

* downgrade to IPluginV2

* implement elementwise clone

* add gelu plugin creator and fix gelu serialization bug

* add swish plugin creator and fix swish serialization bug

* format

* fix typo

* add elementwise plugin creator and fix serialization

* add base creator class

* add gelu plugin creator

* add hard swish creator and fix serialization

* add instance norm creator and fix serialization

* add layer norm creator and fix serialization

* add pool creator and fix serialization

* add prelu creator and fix serialization

* add slice creator and fix serialization

* add swish creator and fix serialization

* add instance norm op unittest

* remove redundent api

* fix wrong graph size to enable trt

* instance norm function move to cc

* add trt elementwise ut to trigger coverage

* remove opt cahce to hit serialization coverage

* remove opt cahce to hit serialization coverage

* remove unused code

* remove unused inputs_

* add dbg info

* remove dbg info

* add instance norm serialization

* roll back

* remove comment code

* remove trt plugin registery

* fix prelu dynamic serialization

* add prelu ut and reduce the input size to reduce memory usage

* fix pool dynamic plugin serialization and add ut

* refine pool ut with subtest

* add env for avoiding oom

* reduce test input size & increase pool op ut to 45s

* add the contributor

* remove copyright (will add in contributor)

* remove copyright (will add in contributor)

* fix trt flatten converter when batch_size > 1

* change ut to same dynamic shape

* add trt LT version helper

* remove deprecated nvinfer1::DimsCHW and replace it to nvinfer1::Dims3

* remove deprecated nvinfer1::DimsNCHW and replace it to nvinfer1::Dims4

* update deserialize engine

* update to createNetworkV2

* update to createNetworkV2

* update buildWithConfig and remove redundent config settings

* replace createNetwork to createNetworkV2

* fix int8

* addMatrixMultiply

* remove unnecessary const cast

* IBuilder->setInt8Calibrator() is deprecated

* auto enable fp16 when using int8

* remove the redundant line

[Inference Tensorrt] Add attr for trt engine and handle the input seq problem for ernie var len. (#33575)

* add support for trt dynamic shape flatten op

* add version restriction

* add ut input dynamic shape