ARCore tutorial

Try-On makeup with Augmented Faces

How to use Augmented Faces functionality from ARCore to create Android try-on beauty app

Youtube has recently released a new AR beauty try-on feature that lets users try on makeup while watching a video tutorial. In this tutorial, you will learn how to create a similar experience using ARCore and Augmented Faces.

Image for post
Image for post
Photo by Gustavo Spindula on Unsplash

Prepare texture material

To be able to build a lipstick try on app a texture is required. We will use a UV texture from a reference face model canonical_face_mesh.fbx. You should get a texture like on the image below. Based on this texture, you can create any overlays you wish.

Image for post
Image for post
Image for post
Image for post
Reference face 3D model & UV map texture
Image for post
Image for post
Image for post
Image for post
UV texture as a face texture & Texture example from ARCore sample code

Adding functionality to Android app

  • Dependencies:
<uses-permission android:name="android.permission.CAMERA" />
<uses-feature android:name="android.hardware.camera.ar" android:required="true"/>
<meta-data android:name="com.google.ar.core" android:value="required" />

Written by

Traveler and a big fan of #AR & #ML. Android & Maps Google Developer Expert. Founder at @Reality_Lab_AS. Blog: https://creativetech.blog

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store