ailia SDK Now Available Through the Unity Package Manager

David Cochard
axinc-ai
Published in
4 min readJun 14, 2024

ailia SDK is now available through the Unity Package Manager to make it easier than ever to integrate ailia SDK into your Unity applications.

About ailia SDK

ailia SDK is an AI inference engine that allows you to easily integrate various AI models published on ailia MODELS into Unity. The applications developed with it can run on Windows, macOS, iOS, Android, and Linux.

About the Unity Package Manager (UPM)

The Unity Package Manager is the official package management tool for Unity. By registering the GitHub URL, you can easily install various packages.

Installing ailia SDK via UPM

Previously, the ailia SDK was provided as a Unity Package, requiring the download of the evaluation version and the configuration of a license file. By using the Unity Package Manager, you can now use the ailia SDK by simply registering the URL within Unity.

ailia x Unity Package Manager

Open the Package Manager from the Window menu.

From the top left, click the + button and select Add package from git URL, then add the necessary URLs from the list below and then click “Add”.

ailia SDK (Core Module)
https://github.com/axinc-ai/ailia-sdk-unity.git

ailia Audio (Required for audio processing)
https://github.com/axinc-ai/ailia-audio-unity.git

ailia Tokenizer (Required for natural language processing)
https://github.com/axinc-ai/ailia-tokenizer-unity.git

ailia Speech (Required for speech recognition)
https://github.com/axinc-ai/ailia-speech-unity.git

ailia TFLite Runtime (Required for NPU inference on Android)
https://github.com/axinc-ai/ailia-tflite-unity.git

Unity Package Manager with ailia modules installed

The installed packages will be displayed in the “Packages” section of your project.

Features of ailia SDK within Unity

With the ailia SDK, you can perform not only image recognition but also speech recognition, translation, OCR, and more.

Speech recognition
Translation
OCR

Usage with ailia MODELS Unity

The sample programs for Unity using the ailia SDK are available in the repository below.

Since ailia-models-unity also loads the ailia SDK via the Unity Package Manager, it is self-contained and can be run it by simply cloning the repository and opening the sample scene.

git clone https://github.com/axinc-ai/ailia-models-unity

Scenes are organized by category.

After opening a scene, the AI model can be changed in the Inspector of the Controller.

The project also includes a sample of yolox using Android’s NPU. In the ObjectDetection sample, set the model to either yolox_tiny_nnapi or yolox_s_nnapi.

Run sample on Android NPU

Points to Note for Each Platform

For Android, it is built by default with Mono + armv7a as 32-bit. Since AI models often handle models larger than 2GB, please build with il2cpp + arm64 for 64-bit.

When using the camera and microphone on iOS, you need to specify the Camera Usage Description and Microphone Usage Description in the Project Settings

ailia SDK API

Please refer to the following page for the APIs available for use with the ailia SDK:

ax Inc. has developed ailia SDK, which enables cross-platform, GPU-based rapid inference.

ax Inc. provides a wide range of services from consulting and model creation, to the development of AI-based applications and SDKs. Feel free to contact us for any inquiry.

--

--