README.md 2.8 KB
Newer Older
L
Liangliang He 已提交
1 2
# MiAI Compute Engine
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](LICENSE)
L
Liangliang He 已提交
3
[![build status](http://v9.git.n.xiaomi.com/deep-computing/mace/badges/master/build.svg)](http://v9.git.n.xiaomi.com/deep-computing/mace/pipelines)
L
liuqi 已提交
4

L
Liangliang He 已提交
5 6 7 8 9
[Documentation](docs) |
[FAQ](docs/faq.md) |
[Release Notes](RELEASE.md) |
[MiAI Model Zoo](http://v9.git.n.xiaomi.com/deep-computing/mace-models) |
[Demo](mace/android)
L
liuqi 已提交
10

L
Liangliang He 已提交
11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
**MiAI Compute Engine** is a deep learning inference framework optimized for
mobile heterogeneous computing platforms. The design is focused on the following
targets:
* Performance
  * The runtime is highly optimized with NEON, OpenCL and HVX. Except for the
    inference speed, the initialization speed is also intensively optimized.
* Power consumption
  * Chip dependent power options are included as advanced API.
* Memory usage and library footprint
  * Graph level memory allocation optimization and buffer reuse is supported.
* Model protection
  * Model protection is one the highest priority feature from the beginning of 
    the design. Various techniques are introduced like coverting models to C++
    code and literal obfuscations.
* Platform coverage
  * A good coverage of recent Qualcomm, MediaTek, Pinecone and other ARM based
    chips. CPU runtime is also compitable with most POSIX systems and
    archetectures with limited performance.
L
liuqi 已提交
29

L
Liangliang He 已提交
30
## Getting Started
31

L
Liangliang He 已提交
32 33 34 35 36 37 38
## Performance
[MiAI Model Zoo](http://v9.git.n.xiaomi.com/deep-computing/mace-models) contains
several common neural networks models and built daily against several mobile
phones. The benchmark result can be found in the CI result page.

## Communication
* GitHub issues: bug reports, usage issues, feature requests
L
Liangliang He 已提交
39 40
* Gitter:
* QQ群: 756046893
L
Liangliang He 已提交
41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

## Contributing
Any kind of contributions are welcome. For bug reports, feature requests,
please just open an issue without any hesitance. For code contributions, it's
strongly suggested to open an issue for discussion first. For more details,
please refer to [this guide](docs).

## License
[Apache License 2.0](LICENSE).

## Acknowledgement
*MiAI Compute Engine* depends on several open source projects located in
[third_party](mace/third_party) directory. Particularly, we learned a lot from
the following projects during the development:
* [nnlib](https://source.codeaurora.org/quic/hexagon_nn/nnlib): the DSP runtime
  depends on this library.
* [TensorFlow](https://github.com/tensorflow/tensorflow),
  [Caffe](https://github.com/BVLC/caffe),
  [SNPE](https://developer.qualcomm.com/software/snapdragon-neural-processing-engine-ai),
  [ARM ComputeLibrary](https://github.com/ARM-software/ComputeLibrary),
  [ncnn](https://github.com/Tencent/ncnn) and many others: we learned many best
  practices from these projects.

Finally, we also thank the Qualcomm, Pinecone and MediaTek engineering teams for
their helps.