* forbid Conv2D into Paddle-TensoRT when weight is not persistable.

* Add infer prune function

* add fusion op

* add fused_attention_pass. test=develop

* support fp16. test=develop

* fix format. test=develop

* Fix quantize model deploy bugs when using MKLDNN (#45920)

* fix immutable op quantize bugs

* fix

* fix build bug

* fix test

* notest,test=inference

* fix ppyoloe acc drop bugs

* fix test

* fix test

* add test

* fix

* fix

* fix test

* fix refined name bug

* fix test

* bias fix

* fix matmul weight dequant bug

* re-ci

* fix tester

* fix test

* fix tester

* update weight dequantize func

* update code

* update test for converage

* update test

* update cmake

* update cmakelist

* update code

* rerun ci

* remove useless code

* re-ci

* update code

* update code

* fix header

* update code for log

* stride_to_24

* fix CI failing

* Enhance the layernorm shift partation fuse op when shift size > 0 (roll shifting)
* fix cherry-pick test

Add symbolic shape deduction function for unfold, scatter_nd_add, p_norm, grid_sampler, pad3d, etc (#46291) (#47003)

* draft with debug print
* remove debug print
* bug fix for ci

cherry-pick : #46322, #46245
Sparse API 支持静态图

* paddle-inference support custom-ops
Co-authored-by: NZhixin Yao <zhixiny@graphcore.ai>

* fix tolower
Co-authored-by: NZhixin Yao <zhixiny@graphcore.ai>
Co-authored-by: NZhixin Yao <zhixiny@graphcore.ai>

* fix reshape2 opteller;
add elementwise min/max register for tensorrt

* fix gather op convert to only support int32 index as input.
* add ut

This reverts commit a2b2af90.

* fix cast bug

* Move ITensor construction for Weight (persistable variable) from OpConvert to TensorRTEngine.

* Support matmul_v2 in Paddle-TensorRT converter.

* fix wrong eigen header include

* fix complie bug

* fix nan_inf_utils_detail

* fix resource_manager

* fix conv_miopen_helper

Co-authored-by: NRichardWooSJTU <37864677+RichardWooSJTU@users.noreply.github.com>

* Support dynamic shape in multiclass_nms3 Plugin for Paddle-TensorRT.

* cherry pick delay tensorrt log
* Update trt_plugin.h

* [OpAttr]Refine Teller logic if encounter OpDesc with Variable type Attribute

* fix iterator

* fix typo

* fix lambda expr

* fix ptr

* enable memory optimize when fp16.

* optimiza params sync between cpu and gpu.

* first commit

* conver done

* correct format

* layernorm_shift_partition

* correct convert

* redefine plugin

* runable

* bug fix

* modify ShiftPartitionPattern

* correct

* add UT

* modify ut

* compile

* modify enforce

* modify UT