Open Neural Network Compiler (ONNC)

Jun 22, 2018 · 2 min read
Image for post
Image for post
ONNC, Open Neural Network Compiler

The Open Neural Network Compiler (ONNC) project aims to provide a compiler to connect Open Neural Network Exchange Format (ONNX) to every Deep Learning Accelerators (DLAs). ONNX is a standard format for representing deep learning models that enables models to be correctly transferred between frameworks, like Caffe, CNTK, MXNet, PyTorch, and TensorFlow. ONNX guarantees interoperability between frameworks. ONNC pushes it further for the industry, guarantee executability between DLAs — to ensure every DLA can execute ONNX models correctly.

ONNC is a backend for DLA vendors, a kind of cross compiler that transforms ONNX models into binary machine code for DLAs. Every DLA has its own unique and delicate design in its memory for fast data movement. ONNC is a compiler that provides sufficient flexibility to handle wide ranges of varieties. It leverages the IR design of ONNX and provides rich and effective algorithms to eliminate the overhead of data movement.

DLA vendors can easily reuse these algorithms by just describing its own unique physical cost model. ONNC’s goal is to assists DLA vendors free from re-inventing these intricate optimization algorithms.

Following subjects are the major features ONNC provides:

  • Liveness analysis
  • Graph IR scheduler
  • Graph level optimizations
  • Tensor Selection
  • Target-related optimization
  • Fine-grained versus Coarse-grained operations
  • PassManager
  • The IRs are used in ONNC
  • Benchmarking
  • Comparison with other AI compilers

We will be sharing articles about ONNC major features on ONNC Medium. Stay tuned.

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch

Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore

Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store