* multithread_memory_optimize

* add mish trt plugin, compile & install success, run error. test=develop

* modify code of mish plugin

* upgrade mish trt plugin

* modify code according to review

* add TRT_NOEXCEPT for mish trt plugin

* add unittest for mish trt plugin

* remove unnecessary check of mish in op_teller.cc

* fix some problem of trt8

* add check and modify unittest while converting mish to trt plugin
Co-authored-by: Ndengkaipeng <dengkaipeng@baidu.com>

* support data_format='NHWC' for prelu channel mode (#37019)

* support data_format='NHWC' for prelu channel mode

* fix prelu weight shape for NHWC of static mode (#38310)

* fix_ele_convert: IElementWiseLayer can broadcast

* fix_ele_convert

fix: when ceil_model==true && Padding_algo!=SAME, (x-size)/stride != int, this convert is wrong (#37929) (#38033)
Co-authored-by: Nfeng_shuai <fengshuai03@baidu.com>

* fix_qkv_plugin: half_scale

* [Paddle-Inference] fix_qkv_plugin: fix half scale

Co-authored-by: NPei Yang <peiyang@baidu.com>

* change api for support trt8

Co-authored-by: Nzlsh80826 <zlsh80826@gmail.com>

* fix wrong trt dim when input dim is 2

* update leaky_relu and instance_norm converter unit test

* add instance_norm input dim check

[Paddle-Inference]Add MatmulV2ToMatmul convert Pass, fix (matmul_v2, matmul, mul) convert pass, fix (matmul, mul) op_teller (#36652) (#36737)

* Add FasterTokenizer Operator (#34491)

Add Tokenizer related functionalities for Transformer model in order that the process of training and predicting is consistent.

* support the text string as an input Tensor
* support the "VOCAB"unordered_map<wstring, int> as an input Tensor to lookup tokens
* Tokenizer used for BERT. This tokenizer applies an end-to-end, text string to wordpiece tokenization.
* It first applies basic tokenization, followed by wordpiece tokenization.

* optimize fast tokenizer

* remove const_cast
Co-authored-by: Nzhoushunjie <zhoushunjie@baidu.com>
Co-authored-by: Nwawltor <fangzeyang0904@hotmail.com>

cherry-pick prs

#36568
fix fc fuse compat problem

#36610
support lite xpu choose device id

#36010
update lite branch

#36628
add file exists check

* update xpu version