Bringing ONNX Models to MicroControllers, IoT and Edge Devices
on-device AI applications running on battery without internet connectivity are gaining ground primarily because of low power, low latency and enhanced privacy benefits. Deploying AI models on the microcontrollers (aka MCUs), IoT or edge device is a tough proposition. Complexities range from developing right model, choosing right framework, model conversion, to identifying the right MCU to fit the use case, etc.
Open Neural Network Exchange (ONNX) is an open standard format for representing machine learning models.