* Enhance the layernorm shift partation fuse op when shift size > 0 (roll shifting)
* fix cherry-pick test

* fix reshape2 opteller;
add elementwise min/max register for tensorrt

* fix cast bug

* Move ITensor construction for Weight (persistable variable) from OpConvert to TensorRTEngine.

* Support matmul_v2 in Paddle-TensorRT converter.

* Support dynamic shape in multiclass_nms3 Plugin for Paddle-TensorRT.

* first commit

* conver done

* correct format

* layernorm_shift_partition

* correct convert

* redefine plugin

* runable

* bug fix

* modify ShiftPartitionPattern

* correct

* add UT

* modify ut

* compile

* modify enforce

* modify UT

* add silu converter

* remove int8 fallback

* vit_384_opt

* just support trt8

* padding + unpadding

* fix:unit test

* refactor:padding

* fix: change the position of round_up

* refactor: delete workspace

* fix bug fix

* add shape size check

* polish code

* multi -1 shape fix

* code style improve

* bug fix

* code style fix

* fix layernormTrt meanVar alloc bug

* add group_norm dyanmic plugin

* convert multihead to oss

* fix:bug

* fix:delete const cast

* fix:don't support bias_qk

* add vit pass

* fix:convert bug and add preln_residual_bias

* support length=-1

* add UT for convert

* add no_bias_qk support for gpu_multihead_op

* delete infer_shape depends on bias_qk

* oss just can be used in T4 and A*

* fix:change api for ROCM CI

* disable_skip_layernorm_fp16

* update trt workspace size param

* update

* update

* update

* use int64_t

* use int64_t

* upate

* update

* add rnn

* remove cudaDeviceContext

* remove more template

* fix rocm compile

* remove alias name CUDADeviceContext

* fix compile

* fix tests

* revert changes

* add varlen_token_prune plugin, pass, convert

* update

* empty commit

* update

* update

* update

* fix_fill_constant

* fix_fill_constant

* fix_ernie

* Rename BOOST_GET macros

* Fix conflicts

* shape sum

* add shape, sum trt layer

* remove useless code in fc

* reshape fill_constant

* commit

* commit

* add fused token prune op and plugin

* fix convtranspose and elementwise

* copy onnxruntime.dll to c++ test folder in windows

* remove ut that failed due to onnxrumtime.dll

* test_api_impl failed of diff

* use TARGET to make sure if the test exist; use POST_BUILD to add copy command