Introducing Selerio SDK for AR

Pavan Kumar
Dec 5, 2018 · 2 min read

What we have been building this year at Selerio

About a year ago Apple released ARKit and Google shortly followed suit with ARCore , both allowing developers to create Augmented Reality (AR) experiences that do not require physical markers or depth cameras.

AR experience using ARKit Source: https://www.mold3d.com/blog/2017/9/20/arkit-release

With this technology you can detect horizontal and vertical surfaces very fast and attach (or anchor) 3D content to the detected surfaces. ARKit/ARCore also provide stable camera tracking. Although these tools were a big step for AR adoption, virtual content is still anchored to surfaces without any context. Meaning that virtual objects have no human-level understanding of the physical world, and are simply overlaid on top of the scene, with no occlusion or context awareness. Until we can have virtual experiences that can make sense and interact with our actual physical spaces, AR will remain a gimmick.

Immersive AR experiences require the context of the scene

Once physical objects are brought into the virtual world with their exact geometry, a whole space of immersive AR experiences become feasible. Uncanny experiences where virtual objects not only appear slick and realistic through the lens but can also interact with objects around us like we do. Imagine you favorite Marvel character relaxing on your sofa, and using your items as if he is actually there!

So how can you create these experiences?

To create a truly immersive experience you need a couple of things: the exact layout of the physical world, 3D objects present in the world around you (read: context), and their respective characteristics (read: 6DOF position). This is an extremely challenging task as we have to achieve these key things on device:

  1. Real time meshing of surfaces for occlusion.
  2. Object recognition along with 6DOF position.
  3. Lastly, and importantly, a smooth 60fps experience.

At Selerio, we set out to achieve exactly this and we are proud to announce the release of our SDK. Below you can see the screen grab of the sample app built using our SDK.

Teaser gif shows the real-time meshing, 6DOF position of the detected object using Selerio SDK

Stay tuned for a series of articles on how we achieved this feat and detailed information on individual features mentioned above. You can get access to the SDK today by joining our closed beta.

Join our slack for any questions, comments and feedback!

Selerio

Context-aware interactions in AR

Thanks to Ghislain Fouodji

Pavan Kumar

Written by

Selerio

Selerio

Context-aware interactions in AR

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade