* fix beta bug in fill_constant_batch_size_like

* add fp16 support

* update

* update half

* code format

* fix unittest

* fix rocm compile error

* code format

* code format

* fix rocm compile error

* fix rocm compile error

* residual_no_bias

* comments

* more ut

* fix input

* [Paddle Inference]support n lookup_tables fuse to embeddinglayernorm(1): add some funtion for embedding

* Support matmul_v2 in PaddleTensorRT

* [Paddle Inference]support n lookup_tables fuse to embeddinglayernorm(2)

* Move ITensor construction for Weight (persistable variable) from OpConvert to TensorRTEngine.

* move sum

* fix ci bugs

* fix ci bugs

* fix set_lod bugs

* fix infershape bugs

* fix ci bugs

* fix ci unittest bug

* fix ci bugs

* perfect code

* update code according comment

* add unittest

* fix ci bugs

* Delay TensorRT registry
* Add unused define
* Fix TensorRT test
* fix function to reference
* Update trt_plugin.h

* update

* update

* update

* [OpAttr]Refine Teller logic if encounter OpDesc with Variable type Attribute

* fix iterator

* fix typo

* fix lambda expr

* fix ptr

* first commit

* conver done

* correct format

* layernorm_shift_partition

* correct convert

* redefine plugin

* runable

* bug fix

* modify ShiftPartitionPattern

* correct

* add UT

* modify ut

* compile

* modify enforce

* modify UT

* add silu converter

* remove int8 fallback

* vit_384_opt

* just support trt8

* padding + unpadding

* fix:unit test

* refactor:padding

* fix: change the position of round_up

* refactor: delete workspace

* fix bug fix

* add shape size check

* polish code

* multi -1 shape fix

* code style improve

* bug fix

* code style fix

* fix bug fix

* fix layernormTrt meanVar alloc bug

* add group_norm dyanmic plugin

* convert multihead to oss

* fix:bug

* fix:delete const cast

* fix:don't support bias_qk

* add vit pass

* fix:convert bug and add preln_residual_bias

* support length=-1

* add UT for convert

* add no_bias_qk support for gpu_multihead_op

* delete infer_shape depends on bias_qk

* oss just can be used in T4 and A*

* fix:change api for ROCM CI

* trt engine input data type should be consistent with trt input bindings type

* fix some bugs

* fix some bugs

* fix some bugs

* disable_skip_layernorm_fp16

* clean tensor.h

* fix gather_nd

* update trt workspace size param

* update

* update

* update

* use int64_t

* use int64_t

* upate

* update