* add cast trt convert

* skip cast trt convert when input dtype is bool

* code format

* fix bug

* update unittest

* fix bug

* [Inference]ort backend optimizer (#44136)

* add ort clone interface

* paddle2onnx update to 1.0.0rc

* ort input_tensor use mutable data of scope

* clone ort_predictor reuse session (#44703)

* ort backend support output mutable data (#44724)

* 2.3 interface is different from the Develop interface

* 2.3 interface is different from the Develop interface

* 2.3 interface is different from the Develop interface

* elementwise support

* commit

* cherry pick form develop 43621

* code format

* paddle2onnx update to 0.9.8

* add bilinear_interp_v2 converter

* update op_teller.cc

* add unittest for bilinear_interp_v2 converter

* code format

* bug fix

* code format and add unittest

* remove merged modify in op_teller.cc

* code format

* code format

* fix scale init error

* Update CUDA and TensorRT version for CI

* disable ut

* Update TensorRT for CUDA 10.2

解决onnxruntime后端依赖的protobuf跟框架或外部protobuf版本冲突问题

cherry-pick PR #42700

* fix paddle-ort python bug

* fix paddle-ort python bug

* update test case output threshold

* update testcase

* fix windows compile test case error

* fix FlattenContiguousRangeOpConverter out dim error

* update code

修复ORT在batch变动时，输出shape不对问题

* update gpu fp16 op blacklist

* update blacklist

* [Phi] Support setting size of vector<Tensor> for out in yaml (#41576)

* support setting vector out size in yaml

* support setting size of vector<tensor> for out in yaml

* resolve conflict
Co-authored-by: Nzyfncg <zhangyunfei07@baidu.com>

* add python share_date interface

* Update inference_api.cc

* add python share_data interface

* change inference demo_test build method to ninja to choose visual studio version automaticly

* notest;test=windows_ci_inference

* set cuda of demo_ci by arg,fix bug of ninja compile,test=document_fix;test=windows_ci;test=windows_ci_inference

* fix bug;test=document_fix;test=windows_ci;test=windows_ci_inference

* fix bug;test=document_fix;test=windows_ci_inference"

* set lib_path according to generator

[cherrypick-2.3] modify infer gpu memory strategy (#41427), remove cudnn_deterministic=True (#41341)  (#41491)
Co-authored-by: NJingZhuangzhuang <75348594+JZZ-NOTE@users.noreply.github.com>

* remove paddle_ipu shared library

* fix unique_name

* add fake index and unittest for multiclass_nms3 trt

* modify unittest

* paddle inference support new quant_model

* filter unsupported inputs for elementwise op in op teller

* add unittest for corner case

fix_reshape: for paddle-trt

* support pinned, test=develop

* support async_write, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* refine,test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop

* refine, test=develop