README.md

    onnxruntime projects

    Introduction

    This repository include codes for some onnxruntime projects,such as classification, segmentation, detection, style transfer and super resolution.

    Onnxruntime

    ONNX Runtime is a performance-focused complete scoring engine for Open Neural Network Exchange (ONNX) models, with an open extensible architecture to continually address the latest developments in AI and Deep Learning. In my repository,onnxruntime.dll have been compiled. You can download it and see specific information about onnxruntime in https://github.com/microsoft/onnxruntime.

    Projects

    The programming language is C++ and The platform is Visual Studio. I have finished some projects based on onnxruntime official samples. The link have been mentioned afore. Also, you can download some onnx models in https://github.com/onnx/models. If necessary,you can see the structure onnx models in https://lutzroeder.github.io/netron/.

    Windows
    Network Classes Input resolution Batch size Iterations CPU Running time GPU Running time TRT Running time*
    MobileNet 1000 224x224 1 1000 19.56s 4.15s 1.05s
    ERFNet 4 640x480 1 1000 >100s 12.93s 5.6s
    Tiny_YOLOv2 20 416x416 1 1000 40.64s 2.97s 1.92s
    Super Resolution with sub-pixel CNN - 224x224 1 1000 34.14s 1.79s 1.14s
    Fast Neural Style Transfer - 224x224 1 1000 87.99s 4.64s -
    Ubuntu
    Network Classes Input resolution Batch size Iterations CPU Running time GPU Running time TRT Running time*
    MobileNet 1000 224x224 1 1000 20.09s 4.24s 0.79s
    ERFNet 4 640x480 1 1000 >100s 13.56s 4.90s

    *The TensorRT engine is compiled with FP16 settings. Just add "trt_builder->setFp16Mode(true);" to 339 line of tensorrt_execution_provider.cc, if you build libonnxruntime yourself.

    **This experiment is implemented on NVIDIA 2080Ti.

    Classification


    The onnx model is moblienet. You can download it in the link mentioned afore.

    Segmentation


    The onnx model is our trained erfnet. We use specific datasets to train erfnet.

    Detection


    The onnx model is Tiny YOLOv2.You can download it in the link mentioned afore.

    Style transfer


    The onnx model is Fast Neural Style Transfer. You can download it in the link mentioned afore.

    Super resolution


    The onnx model is Super Resolution with sub-pixel CNN. You can download it in the link mentioned afore.

    项目简介

    Code for some onnxruntime projects

    🚀 Github 镜像仓库 🚀

    源项目地址

    https://github.com/tenglike1997/onnxruntime-projects

    发行版本

    当前项目没有发行版本

    贡献者 2

    tenglike @qq_38072352
    T tenglike1997 @tenglike1997

    开发语言

    • C++ 69.4 %
    • Objective-C 19.9 %
    • Makefile 5.5 %
    • C 4.6 %
    • QMake 0.7 %