- 02 6月, 2022 1 次提交
-
-
由 Wangzheee 提交于
* new general transformer inference support
-
- 20 7月, 2021 1 次提交
-
-
由 zlsh80826 提交于
* add trt noexcept definition * add trt noexcept on trt plugin * add trt noexcept on trt int8 calibrator * remove noexcept on base serialize * add trt noexcept on split plugin * add trt noexcept on elementwise plugin * add trt noexcept on prelu plugin * add trt noexcept on pool plugin * add trt noexcept on swish plugin * add trt noexcept on gelu plugin * add trt noexcept on layer norm plugin * add trt noexcept on instance norm plugin * add trt noexcept on emb eltwise layernorm plugin * add trt noexcept on qkv2context plugin * add trt noexcept on skip layernorm plugin * add trt noexcept on slice plugin * add trt noexcept on hard swish plugin * add trt noexcept on stack plugin * add trt noexcept on special slice plugin * add trt noexcept on anchor generator plugin * add trt noexcept on yolobox plugin * add trt noexcept on roi align plugin * add trt noexcept on gather nd plugin
-
- 05 6月, 2021 1 次提交
-
-
由 Wilber 提交于
-
- 03 11月, 2020 1 次提交
-
-
由 Shang Zhizhou 提交于
* fp16 result ok * change -DWITH_NVINFER_PLUGIN toconfig.EnableTensorRtOSS * auto detect special slice op converter for ernie with trt oss * ernie oss only support fp16 * fix special_slice_plugin serialize bug * matmul in tensorrt ok * ernie unittest ok * add matmul tensorrt unittest * remove demo code
-
- 01 9月, 2020 1 次提交
-
-
由 zlsh80826 提交于
* add stack_op to CMakeLists * add dim=3 support for scale op * add trt stack op, test=develop * remove debug message * add stack plugin serialize * remove slice, scale op, will add later * enhence error message * revise trt ernie test to conver the stack op CI testi, test=develop * add stack op serialization * fix test shape after adding stack op * remove slice op, will add after implementing serialization * roll back to min_graph=5 to avoid using slice op * fix scale op output layer * implement stack op createPlugin * use workspace and move the defination to .cu * move stack plugin creator definition to .cu, test=develop
-
- 19 4月, 2020 1 次提交
-
-
由 Zhaolong Xing 提交于
* refine ernie trt dynamic shape support 1. add slice op converter 2. add emb eltwise layernorm fp16 support test=develop * fix dynamic shape test ut test=develop * fix comments. test=develop * fix comments test=develop
-
- 26 3月, 2020 1 次提交
-
-
由 Zhaolong Xing 提交于
* add dynamic plugin support. test=develop * change emb eltwise layernorm to math function test=develop * add emb eltwise layernorm test=develop * can run dynamic shape ernie test=develop * fix ci test=develop * add ut for trt ernie dynamic test=develop * refine dynamic shape c++ interface. test=develop * fix comments test=develop * fix comments test=develop
-