Release v1.3

New hardware backend support

  • Support NV GPU by CUDA and cuDNN
  • Support NV GPU by TensorRT Plugin
  • Support VeriSilicon NPU by TIM-VX Plugin

New Training Framework‘s model support

  • The tengine-convert-tool try to support the model of OneFlow

Fix error

  • Refactor the code of ACL Plugin to fix the bug of compile or inference on Mali GPU

CI/CD

  • Add code coverage mode in CI action
  • Add model test in CI action, such as classification, detection, recognition and segmentation

P.S.

  • NV GPU we have tested with the following devices
    • GeForce RTX 3090
    • GeForce GTX 1080Ti
    • QUADRO RTX 8000
    • Jetson AGX/NX/NANO
  • VeriSilicon NPU we have tested with the following devices
    • Khadas VIM3

项目简介

Tengine is a lite, high performance, modular inference engine for embedded device

🚀 Github 镜像仓库 🚀

源项目地址

https://github.com/OAID/Tengine

发行版本 20

Tengine Lite release v1.5 for NVDLA

全部发行版

贡献者 88

全部贡献者

开发语言

  • C++ 49.7 %
  • C 41.1 %
  • Assembly 5.3 %
  • CMake 2.1 %
  • Python 1.1 %