AI POWERED XR SERIES
Meta AI: Developing AI-powered XR App for ThinkReality VRX
In this series of articles, we will explore how Meta AI is powering the next generation of XR experiences, and in this article let’s learn about developing XR application using Meta AI for ThinkReality VRX.
⬅ Previous || Current |️|️ Next ➡
As the lines between the physical and digital worlds continue to blur, Extended Reality (XR) devices and AI-powered applications are becoming essential for creating truly immersive experiences. In our last article, we explored developing a Meta AI-powered app for the Meta Quest device. However, with the rapid growth of XR devices, the need for interoperable solutions is more crucial than ever.
We also outlined the steps to port a simple Meta Quest app to another XR device, the ThinkReality VRX. In this article, we’ll apply those steps to port the Meta AI app from Quest to the ThinkReality VRX. Before we dive in, let me introduce you to the ThinkReality VRX:
Lenovo ThinkReality VRX
The ThinkReality VRX, developed by Lenovo, is a cutting-edge XR device designed to enhance immersive experiences and boost productivity. Equipped with four front-facing cameras, the VRX allows for intuitive interaction with virtual objects, creating a seamless blend of the digital and physical worlds. Its pass-through technology supports mixed reality (MR) applications, enabling the overlay of 3D graphics onto real-world environments. This all-in-one XR device also features two full-color, high-resolution cameras for an integrated and smooth user experience.
Building an app using Meta AI for VRX device
It require Qualcomm Snapdragon Space SDK, to build an application for ThinkReality VRX. You may follow official documentation for building VRX applications if you want to build from scratch.
Since we have already developed a Meta AI app for the Oculus Quest in previous article, and we will start from that (Git link), checkout and open it in Unity, and here we will just port that quest app to VRX by following simple steps shared in another article :
Step 1 — Remove Quest/Meta Dependencies
In the Scene Hierarchy, locate and remove any Quest-specific prefabs, such as the OVR Camera Rig and OVR Interaction GameObjects. These are tailored to the Oculus Quest and aren’t needed for the VRX.
Navigate to the Package Manager and find the Oculus XR Plugin under “Packages in Project.” Select it and click “Remove” to uninstall the plugin.
Similar to the previous step, remove the Meta All-in-One SDK from your project via the Package Manager.
Step 2: Add Snapdragon Space SDK
- Download the Spaces SDK from its official website
- In the Package Manager, select “Add Package from Tarball.”
- Choose the downloaded Spaces SDK tarball file to integrate it into your project.
Step 3: Configure OpenXR
- Navigate to Edit → Project Settings → XR Plugin Management.
- Install and select OpenXR as the XR management option.
- In the OpenXR settings, select Snapdragon Spaces as the primary feature group.
- Address any project validation issues that may arise.
- Add any necessary interaction profiles to align with the VRX’s capabilities.
Step 4: Add XR Origin for Controller Interaction
- In the Scene Hierarchy, right-click and select XR → XR Origin (VR).
- This action will automatically create an XR Interaction Manager GameObject in your scene.
Step 5— Build and Install on VRX
Make a build and install it on the device by connecting to USB-C over ADB.
MetaAI live on VRX
With these steps, your Meta AI-powered app will be ready to run on the ThinkReality VRX, taking full advantage of its advanced features and capabilities.
Here is a demo of the app
You can find the above codebase here — link
(Please make sure to install Spaces SDK from official portal)
Next we will share more engineering practices at Thoughtworks for AI and XR solutions, and share automated ways to port the applications from one platform to other, or use using AI for XR content generation.
Keep learning, Keep sharing!
⬅ Previous || Current |️|️ Next ➡
