ARCore, Sceneform & Augmented Images #1 Android Augmented Reality
What is AR and ARCore?
In the following series we will be learning about ARCore and use Google’s Sceneform SDK and Augmented Images to develop an app which will allow user to place 3D model object in the real world. We will be developing an app which will detect a car image and then place a similar 3D car model over it in real world. Cool! Isn’t it? That is the power of ARCore — building immersive user experience.
Prerequisites
- Android development experience.
- Augmented reality support device or the AR supported emulator (See here for supported devices and configuring emulator)
Follow here:
- Part 1 — Overview of AR and ARCore
- Part 2 — Overview of Sceneform Augmented Images and it’s core APIs
- Part 3 — Building ARCore App using Sceneform
What is AR (Augmented Reality)?
In simple words AR is placing virtual objects in real world. It is mixing real world and computer generated models.
AR vs VR
VR does not mix with the real world. Environment in VR can be similar to real world but not real. AR uses the real world as base environment for creating immersive experience.
ARCore
ARCore is Google’s platform for creating AR apps. Using different APIs it enables phone to sense its environment, understand the world and interact with objects.
How does it work
ARCore works on the following fundamental concepts :
- Motion Tracking
Motion tracking uses input from camera and sensors like accelerometer and gyrosocpe to find the relative position and orientation of the user to the environment. It visually detects feature points in real world and tracks it which means if you are returning to same position after moving around room you should be able to see same object lying at initial position.
2. Environmental Understanding
ARCore is intelligent enough to detect horizontal or vertical planes in environment by detecting cluster of feature points either in horizontal or vertical direction. We can use this planes to place virtual objects.
3. Light Estimation
ARCore allows the phone to estimate current environment’s light condition and we can use these features to create more immersive experience. You can also adjust the colors.
What’s Next?
As of now we have learnt about AR, ARCore and it’s fundamental concepts. In next part we will learn about Sceneform and Augmented Images.