Augmented Reality: Drawing Instructor Concept

Drawing. We all loved it as kids, but as we grew up most of us lost touch. Unlike skills such as coding or math, its physical nature makes it nearly impossible to give instructional feedback via software or online courses, and private lessons are too much of commitment and often expensive.

With Augmented Reality headsets like Windows HoloLens and MagicLeap One starting to hit the main stream, I wanted to explore a competency-based drawing instruction app that analyzes, tracks and rewards drawing progress in hopes of helping us rediscover one of our earliest past times.

The experience starts by having the user define the drawing canvas…

A new session could be initiated by capturing a real-world object or browsing a gallery of 3D models which could be virtually placed in front of the user. In this example, the user selects to capture a wooden human figurine, by tracing its outline with his finger…

Once the users’s selection is complete, users have the option to validate their selection or to correct it…

Once the selection’s confirmed, the fun begins…

There‘s a real-time feedback UI indicator for the user…

As the user improves in capturing form and proportions, positive feedback is received in the form of points. Also notice the red dot has now changed to yellow, indicating progress…

When users deviate from capturing the correct form or skew proportions, problematic areas are highlighted and helpful hints are displayed…

The lower left corner “+” icon expands a menu with several options, one of which is the “Peek” feature; it overlays a photo of the real object on top of the user’s drawing in order to compare how accurate the drawing is…

Once the user is satisfied with their drawing, they receive a report card that grades them based on their relative progress, and offers useful tips for improvement. Since the user is wearing a headset, a video timelapse is recorded as well, tagged with the location of the drawing session and options to share it to their social networks.


Rather than a thoroughly thought out solution, this concept is meant to be a conversational starting point that aims to explore how we could apply AR in areas that are currently unreachable via traditional tech. Would love to hear any feedback or ideas you might have in the comments.


This project was originally published on July 7, 2015.