How the heck do I prototype for augmented reality ?

John Rodrigues
Sep 7 · 3 min read

Lately I have been learning about augmented reality and mixed reality. As product designers, we focus on defining the problem statement, discovering potential opportunities, iterating , testing our concepts and many more.

Other factors such as voice inputs , object resizing , rotation and various other interactions have to be thought of before we hand off the designs to the developers

The question that I had is how do we prototype these storyboards and narratives. During the wire-framing phase, nothing can replace the pen and paper. However, at some point when we reach the mid-fidelity phase, we face the limitations, as the current prototyping tools we are familiar with , fail to deliver it. Its important to show your concepts and not just tell.

Show not tell

While there are many tools coming up, I have been experimenting with two softwares- Adobe After Effects and Torch app.

Game development engines like unity and unreal have higher learning curve, but trying to learn them when there is a time constraint could be counter productive. However, if you have the time please do learn these softwares, as they can open up some interesting possibilities for you.

I think the debate of the future won’t be ‘should designers learn code?’ But it most likely will be ‘should designers learn game engines?’ hahaha ( exciting times).

Anyway, let’s jump in on my experiments

Adobe After effects for prototyping.

Camera tracking with after effects

Adobe after effects comes with a camera tracking, audio editing and 3D model import option in it. This helps to show the concepts and narrations to your team.

It might have some learning curve to it, but dedicating some amount of time learning it is definitely worth it. According to my research, one of the best course is by Issara from UX in motion, which teaches you how to use Adobe after effects as a prototyping tool for creating augmented reality experiences.

AR based navigation prototype made in after effects


Torch is a prototyping tool designed specially for augmented reality, which lets you import your 3d models, visualize , implement marker based AR, create interactions, and also help in translating the narratives.

Here is the quick demo I did with AR torch.


Learning these tools won’t make you an AR UX designer. There are a lot of human factor considerations in the process. However, during the prototyping phase of your process, these tools will help you articulate your designs well to your team.While there are many other prototyping tools, these are some that I have been experimenting with personally.

whats next ?

I have been experimenting with hololens. It seems like they some workflow integrated for designers and will be writing about it in the next blog post.

Made with hololens

Thank you for reading

Written by

John Rodrigues | User Experience and Interaction design Student at Thomas Jefferson University. | Portfolio: |Product designer at Blackstone Launchpad Jefferson

John Rodrigues

Written by

User experience and interaction design student at Thomas Jefferson university | Founder of D&D SmartLabs| Product designer at Blackstone Launchpad Jefferson

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade