What we have been building this year at Selerio
About a year ago Apple released ARKit and Google shortly followed suit with ARCore , both allowing developers to create Augmented Reality (AR) experiences that do not require physical markers or depth cameras.
With this technology you can detect horizontal and vertical surfaces very fast and attach (or anchor) 3D content to the detected surfaces. ARKit/ARCore also provide stable camera tracking. Although these tools were a big step for AR adoption, virtual content is still anchored to surfaces without any context. Meaning that virtual objects have no human-level understanding of the physical world, and are simply overlaid on top of the scene, with no occlusion or context awareness. Until we can have virtual experiences that can make sense and interact with our actual physical spaces, AR will remain a gimmick.
Immersive AR experiences require the context of the scene
Once physical objects are brought into the virtual world with their exact geometry, a whole space of immersive AR experiences become feasible. Uncanny experiences where virtual objects not only appear slick and realistic through the lens but can also interact with objects around us like we do. Imagine you favorite Marvel character relaxing on your sofa, and using your items as if he is actually there!
So how can you create these experiences?
To create a truly immersive experience you need a couple of things: the exact layout of the physical world, 3D objects present in the world around you (read: context), and their respective characteristics (read: 6DOF position). This is an extremely challenging task as we have to achieve these key things on device:
- Real time meshing of surfaces for occlusion.
- Object recognition along with 6DOF position.
- Lastly, and importantly, a smooth 60fps experience.
At Selerio, we set out to achieve exactly this and we are proud to announce the release of our SDK. Below you can see the screen grab of the sample app built using our SDK.
Stay tuned for a series of articles on how we achieved this feat and detailed information on individual features mentioned above. You can get access to the SDK today by joining our closed beta.
Join our slack for any questions, comments and feedback!