This is how we used Apple’s Reality Converter to create animated 3D objects for Cubemint
Export animated 3D objects of Blender to a usdz extension with Reality Converter
Why we decided to use the usdz extension
Our audio metaverse platform Cubemint is made up of independent spaces called “Cubes”. These augmented audio spaces each have their own scene and atmosphere. To make the experience for users as immersive as possible, we decided to create 3D objects in Blender.
We exported them to usdz extensions with Reality Converter to see them come alive in AR. This extension also has a high affinity with Xcode, which makes it easy to implement in existing code.
What can you do with the usdz extension?
- See AR images on your iOS device without using a third-party application.
- Make it compatible with Xcode and other AR development tools.
Number 1 is pretty straightforward. When you convert the file to an usdz extension and open it on an iOS device, it will be shown in AR.
If the service is targeted at iOS devices, a simple AR application can be created just by creating a mechanism to open this file.
As for number 2, I’m not a coder, so I don’t know, but if you develop AR on Mac, why not go ahead and try it?
How to use Reality Converter to convert to usdz
First, we will model a random 3D object in Blender.
In this case, we will export an animation of a twisting cube and icosahedron (a 20-faced geometric figure, basically).
If you’re planning to use your Blender file in Reality Converter it is better to export it to a GLTF file since Reality Converter is officially using OBJ/GLFL files as of April this year.
When you finished making your 3D model select [File>Export>glTF] and export to a folder of your choice.
I think I have read an article somewhere that there is a limit to the animation time and object size, but I’m not sure. Please let me know in the comments below if you do.
Next, install Reality Converter. Apple is currently beta testing the software. Download it here ↓.
https://developer.apple.com/jp/augmented-reality/tools/
When launching the software, you should be able to see a screen like the one in the screenshot below.
Drag and drop the 3D file you previously created in Blender in Reality Converter.
Once the export is complete, drag and drop the file into the Reality Converter startup screen mentioned earlier.
If all goes well, you should see the file appear like this.
Tap on the symbol in the upper right corner of the screen to edit materials and other display details.
Select an export destination from the upload symbol in the upper right corner of the screen and save the file.
Be sure to press the stop button of the animation at the bottom of the screen before exporting. If you do not do this, the animation will start from the end of the animation when it is exported, and we have confirmed that the display will be buggy.
When you open the exported file on your iPhone, it will look something like this.
You can now see our 3D objects in AR anywhere you want! I hope it worked out well for you. If you have any questions, please let me know in the comments below!
Download Cubemint and try out the world’s first audio metaverse platform.
