1. 27 1月, 2022 1 次提交
    • W
      [Paddle-Inference]: fix concat slice (#39096) · f080e8d5
      Wangzheee 提交于
      * Paddle-Inference:fix_concat_slice
      
      * Paddle-Inference:fix_concat_slice
      
      * Paddle-Inference:fix_concat_slice
      
      * Paddle-Inference:fix_concat_slice
      
      * [Paddle-Inference]: fix concat slice
      
      * [Paddle-Inference]: fix concat slice
      
      * [Paddle-Inference]: fix concat slice
      f080e8d5
  2. 20 7月, 2021 1 次提交
    • Z
      [Paddle-TRT] Add noexcept on methods inherited from TensorRT (#34157) · b5aab4f0
      zlsh80826 提交于
      * add trt noexcept definition
      
      * add trt noexcept on trt plugin
      
      * add trt noexcept on trt int8 calibrator
      
      * remove noexcept on base serialize
      
      * add trt noexcept on split plugin
      
      * add trt noexcept on elementwise plugin
      
      * add trt noexcept on prelu plugin
      
      * add trt noexcept on pool plugin
      
      * add trt noexcept on swish plugin
      
      * add trt noexcept on gelu plugin
      
      * add trt noexcept on layer norm plugin
      
      * add trt noexcept on instance norm plugin
      
      * add trt noexcept on emb eltwise layernorm plugin
      
      * add trt noexcept on qkv2context plugin
      
      * add trt noexcept on skip layernorm plugin
      
      * add trt noexcept on slice plugin
      
      * add trt noexcept on hard swish plugin
      
      * add trt noexcept on stack plugin
      
      * add trt noexcept on special slice plugin
      
      * add trt noexcept on anchor generator plugin
      
      * add trt noexcept on yolobox plugin
      
      * add trt noexcept on roi align plugin
      
      * add trt noexcept on gather nd plugin
      b5aab4f0
  3. 12 7月, 2021 1 次提交
    • Z
      [Paddle-TRT] IPluginExt -> IPluginV2 (#33680) · 394f92aa
      zlsh80826 提交于
      * add trt LT version helper
      
      * upgrade PluginTensorRT to IPluginV2Ext
      
      * trt plugin factory is not usable in IPluginV2
      
      * upgrade add plugin api to use IPluginV2
      
      * remove IPlugin register and adapt getSerializeSize(), serialize()
      
      * adapt IPluginV2Layer
      
      * downgrade to IPluginV2
      
      * implement elementwise clone
      
      * add gelu plugin creator and fix gelu serialization bug
      
      * add swish plugin creator and fix swish serialization bug
      
      * format
      
      * fix typo
      
      * add elementwise plugin creator and fix serialization
      
      * add base creator class
      
      * add gelu plugin creator
      
      * add hard swish creator and fix serialization
      
      * add instance norm creator and fix serialization
      
      * add layer norm creator and fix serialization
      
      * add pool creator and fix serialization
      
      * add prelu creator and fix serialization
      
      * add slice creator and fix serialization
      
      * add swish creator and fix serialization
      
      * add instance norm op unittest
      
      * remove redundent api
      
      * fix wrong graph size to enable trt
      
      * instance norm function move to cc
      
      * add trt elementwise ut to trigger coverage
      
      * remove opt cahce to hit serialization coverage
      
      * remove opt cahce to hit serialization coverage
      
      * remove unused code
      
      * remove unused inputs_
      
      * add dbg info
      
      * remove dbg info
      
      * add instance norm serialization
      
      * roll back
      
      * remove comment code
      
      * remove trt plugin registery
      
      * fix prelu dynamic serialization
      
      * add prelu ut and reduce the input size to reduce memory usage
      
      * fix pool dynamic plugin serialization and add ut
      
      * refine pool ut with subtest
      
      * add env for avoiding oom
      
      * reduce test input size & increase pool op ut to 45s
      
      * add the contributor
      
      * remove copyright (will add in contributor)
      
      * remove copyright (will add in contributor)
      394f92aa
  4. 23 3月, 2021 1 次提交
    • S
      fix tensorrt output varible reshape (#31733) · 9d04ef73
      Shang Zhizhou 提交于
      * fix tensorrt output varible reshape
      
      * move padding shape x 1 x 1 in ernie to qkv and fc
      
      * update layer name
      
      * fix softmax when input is dynamic, fc not padding any more
      
      * fix varlen
      
      * move fc x_dim assert to op_teller
      9d04ef73
  5. 10 3月, 2021 1 次提交
  6. 03 11月, 2020 1 次提交
    • S
      TensorRT中ernie模型推理性能优化,支持变长输入 (#28367) · ea851796
      Shang Zhizhou 提交于
      * fp16 result ok
      
      * change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS
      
      * auto detect special slice op converter for ernie with trt oss
      
      * ernie oss only support fp16
      
      * fix special_slice_plugin serialize bug
      
      * matmul in tensorrt ok
      
      * ernie unittest ok
      
      * add matmul tensorrt unittest
      
      * remove demo code
      ea851796