Place UI Kit — The future of augmented reality mobile apps

Volodymyr Kurbatov
Feb 12, 2018 · 4 min read

When Apple released ARKit, designing for augmented reality wasn’t defined as a field. But during autumn of 2017 in App Store appeared a lot of AR apps. Almost all of them used ARKit.

In the beginning, the user flow of augmented reality applications wasn’t clear. I wanted to define what interaction patterns are the most popular in ARKit apps. So, I made an extensive analysis of the onboarding process for almost all apps available in the App Store. Also, I have made UX reviews for free just to get experience and more insights.

I keep noticing that for the first time users was tough to understand how AR works. Also, UI wasn’t clear even for experienced in AR users. So the learning curve for new users became even longer.

It looks like first demos build mostly by Unity and iOS developers. Obviously, they didn’t have the time or any other resources to hire experienced UX designer. Those times there wasn’t settled interactions patterns that could be followed.

Thus in my article “Onboarding in augmented reality mobile application” I tried to cover the essential steps and clarify what to focus and what to avoid. I hope that it made at least a single app more user-friendly.

After some time Apple and Google released own guidelines for AR apps. Although they are beneficial, they still left blind spots. I do recommend to have a look if you didn’t have a chance to learn them.

While the time I collected a lot of screenshots and started noticing some pattern in building user flows and using UI components in AR apps. So I decided to create a UI kit that could be sophisticated enough for designers, but also can be useful for developers that can find suitable UI solutions to copy.

For easy searching I sorted all the screens in the next categories:

Scanning:

It’s first and the most confusing moment for first-time users. An app should gently (or not) let a user know that it needs some info about the environment.

Placing:

Once application scanned area and detected planes, a user can start placing 3d content. There are different interaction patterns, that can be suitable for different situations.

Manipulate and tips:

This step is about playing with augmented objects itself. In flat UI there are a lot of stable well-know patters, as swipe from the top to update page, and so on. In AR it’s like the wild west. Apple and Google tried to define some situations. But sometimes a case requires unique interactions. It’s critical to introduce them gently. Depending on the importance it can be small tip net to the button or almost full-page popup.

Image for post
Image for post

Location:

Maybe the most well known AR app is Pokémon GO, what is location-based. I hope that in future we will get much more interesting cases of using location-based augmented reality

Image for post
Image for post

Catalogues:

For some applications, AR isn’t the main feature. Show object in AR is the only option. Apple suggested the icon for consistency. But I haven’t noticed it in any application that I tested. Also, lists and galleries are the most obvious ways to find a model.

Image for post
Image for post

Camera view:

All his time a user spends in the camera view. There can be various UI components that help interact with the AR world.

Image for post
Image for post

Icons:

To quickly explain some gestures and concepts to a user I created the collection of icons:

Image for post
Image for post

I hope that this collection will help to create more user-friendly augmented reality mobile applications.

😎 Download Full Version on Gumroad

🤗 Download Free Version on Gumroad

👨‍💻 Check full preview on Behance

Originally posted on vovakurbatov.com

Inborn Experience (UX in AR/VR)

Learn about user experience in augmented and virtual…

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch

Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore

Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store