9 Augmented Reality SDKs for Designers
Sharing what I’ve learned about SDKs to make your life easier.
The augmented reality (AR) ecosystem is thriving. I’ve noticed that this semester with my critical makings class that there’s never been a better time to consider how your product offering can be extended into AR. I’ve also learned that the right SDK will depend entirely upon the precise requirements of your project. I believe that the demand for AR apps is anticipated to soar in the couple of years, thus it is vital to know where to begin your search for the appropriate augmented reality SDK.
What Is an Augmented Reality SDK?
An augmented reality SDK or Software Development Kit is the core technological software engine that powers the development and creation of new AR apps and experiences. The role of the AR SDK is to perform the non-trivial task of fusing digital content and information with the real world. The capabilities of the SDK will ultimately underpin the features and functionality within your AR application, so it’s essential to choose the correct platform based on the requirements of your project.
To break it down further…
The AR SDK is responsible for many components of the applications, which are currently available, including content rendering, AR tracking, and scene recognition. Content rendering relates to the digital information and 3D objects that can be overlaid on top of the real world, tracking represents the ‘eyes of the application,’ and the scene recognition element acts as the central nervous system of the application. Each AR SDK will be equipped with its own unique properties that will enable AR developers to recognize, render, and track the application in the most optimal manner possible.
Here are the 9 best augmented reality SDK’s :
This week I dove into exploring possible AR SDKs for my final project and here are a couple of softwares I found.
1.) The one and only “ARKit”
In 2017, Apple released iOS 11, as well as launching ARKit which witnessed arguably the most seismic event in the history of augmented reality technology. ARKit is a unique framework that enables brands and developers to design and create unparalleled experiences for compatible iPhone and iPad devices (compatible iPhone’s and iPad’s must be equipped with an A9 processor or above). The ARKit SDK functions in the same way as most AR SDK’s function, by enabling digital information and 3D objects to be blended with the real world but offers largely unparalleled accessibility in terms of the number of existing devices that it supports.
ARKit can be run on any device equipped with an Apple A9, A10, or A11 processor and utilizes VIO (Visual Inertial Odometry) to track the surrounding environment with seamless levels of accuracy. VIO enables the ARKit to combine Core Motion data with camera sensor data and provides the ability to develop applications that can detect horizontal planes (floors and tables) and vertical planes (walls). This enables the ARKit to accurately understand the dynamics and make-up of a particular scene and provides the ability to place 3D objects and overlay digital information in a contextually relevant way (for example, because ARKit understands the difference between a floor and a table, it knows to place say a bottle of wine on the table, rather than the floor).
Developers and businesses can create applications using ARKit and associated optimizations via third-party 3D engines such as Unity, Unreal Engine, and SceneKit.
ARKit provides the following functionalities:
- SLAM tracking (simultaneous localization and mapping) and sensor fusion
- Ambient lighting estimation
- Scale estimations
- Vertical and horizontal plane estimation with basic boundaries
- Stable and fast motion tracking
2.) ARCore
ARCore is Google’s proprietary augmented reality SDK. Similar to ARKit, it enables brands and developers to get AR apps up and running on compatible Google smartphones and tablets. One of the most notable features of ARCore is that it also supports iOS-enabled devices and gives developers unparalleled access to users across both platforms. ARCore possesses three significant features that enable developers to merge the real world with the virtual:
- Light estimation: Estimates real-world lighting conditions
- Environmental understanding: Detects the size and location of vertical, horizontal and angled surfaces
- Motion tracking: Understands the phone’s position relative to its surroundings
The entire ARCore offering is heavily built around two key elements: real-time tracking and the calculation of the device’s location, paired with the integration of virtual objects with the real-world environment. This enables businesses and brands to develop rich and immersive mobile supported AR experiences, enabling 3D objects, text, and digital information directly into the surrounding real-world environment. ARCore is free to use for developers and supports a range of Android-enabled (and iOS enabled) smartphones and tablets including Samsung Galaxy and Google Pixel, plus many more.
3.) Vuforia
Vuforia is an augmented reality SDK that enables businesses and app developers to quickly spin-up high fidelity, mobile-centric, immersive AR experiences. The Vuforia SDK leverages computer vision technology to identify and track image targets and 3D objects in real-time. This functionality AR developers to orient and place virtual objects, including 3D models and other content, in relation to the real-world environment. 3D models and digital information can then be overlaid on top of the real-world scene and viewed in relation to the environment via an AR-enabled smartphone or tablet. The Vuforia augmented reality SDK is capable of supporting a wide variety of 3D and 2D targets, including 3D multi-target configurations, markerless image targets, and fixed markers referred to as a ‘VuMark.’ Some of the additional features in the Vuforia SDK include localized occlusion detection using virtual buttons, the capacity to develop and calibrate target sets at runtime, and runtime target image selection. Vuforia provides API’s (application programming interfaces) in Java, C++ and Objective C++, and .NET via an extension of the Unity game engine. With this in mind, Vuforia SDK is capable of supporting both native development for iOS and Android and the development of AR apps and prototypes in Unity that can easily be ported across both platforms. This represents a great option for businesses and brands seeking to develop apps that cover both iOS and Android whilst minimizing commercial and technical risk. This means AR apps can be developed seamlessly for the widest possible number of target mobile devices in the shortest possible time scale.
4.) Wikitude
Wikitude is an SDK specifically designed for developing mobile AR apps and prototypes. The company was founded back in 2008 in Salzburg, Austria. When the Wikitude SDK was initially launched, the platform was designed with a core objective: to enable AR developers to create location-centric augmented reality experiences through the Wikitude World Browser app. Fast forward to 2012 and Wikitude repositioned its core technology offering by launching the Wikitude SDK with geolocation features, tracking, and image recognition all baked directly into the core platform.
The Wikitude SDK is now the company’s core product offering and promises developers the ability to create immersive mobile AR experiences in the shortest possible time frame. The Wikitude SDK now also includes functionality such as 3D model rendering, location-based AR, and video overlay. The company latterly rolled out SLAM technology (simultaneous localization and mapping), which facilitates seamless object tracking and recognition alongside markerless instantaneous tracking.
The Wikitude SDK works across multiple platforms and is currently available to support Windows OS, iOS, Android and a number of HUD’s or heads up displays. Wikitude claims to be the first ever SDK to focus entirely on a location-based approach to creating augmented reality applications for cross-platform mobile AR development and smart eyewear devices.
5.) EasyAR
The EasyAR SDK is available to businesses and developers but in order to use you need to pick one of the following packages : EasyAR SDK Basic and EasyAR SDK Pro. The basic package promises developers enhanced API’s, workflow, and increased compatibility. The Pro package is brand new and is equipped with exclusive features that are not available in the basic package. The basic package is free to developers looking to develop AR applications and supports the Java API for Android, the Swift API for iOS, and also supports Windows OS. Some of the additional features supported by the basic package include video playback, transparent video playback, QR code scanning, and comprehensive Unity integration.
The EasyAR Pro package is available with all of the features associated with the free package on the basic version of the platform, plus support for SLAM, 3D object tracking, screen recording and simultaneous detection and tracking for multiple types of targets.
The core feature offering of the EasyAR Pro package focuses around the following: SLAM (including Monocular real-time 6 DOF camera pose tracking and full mobile compatibility), 3D-object tracking (equipped with the ability to recognize and track a common 3D object complete with textures in real-time), screen recording (provides a simple and efficient way of recording AR content), planar image tracking (ability to track and identify planar images in real-time), a concise API that integrates with all major mobile AR platforms and content, and interaction support in order to display the most compelling AR content with additional functionality. The EasyAR website is packed with many useful information to get your AR app up and running in the shortest possible timeframe.
6.) Onirix
Onirix promises effortless mobile AR development and was designed primarily to offer developers a fast and intuitive experience. Onirix Studio enables businesses and brands to develop, host, and publish the visual elements of each new AR project that is created. The Onirix platform provides a range of different features for each new AR project including the ability to add specific points of interest based on location, routes and wayfinding, 3D models, and a range of other information. Onirix leverages a cloud-based platform that enables each project to be assigned the optimal level of resource and performance, which, in turn, provides an optimal level of experience for the mobile user. The Onirix AR SDK is tightly integrated with their native iOS and Android apps.
The Onirix SDK itself was developed specifically to interact with AR-enabled smartphones and tablets. The SDK provides utilities and libraries for simple and quick application development for Unity, iOS, and Android. Their complementary REST API enables existing data sets to be baked into new AR apps and experience with ease. The Onirix team do a great job of constantly updating documentation for all supported components and compatible devices. This includes support and documentation for iOS, Android, associated ARKit and ARCore libraries, with support for Magic Leap and HoloLens as well.
7.) MaxST
The MaxST augmented reality SDK provides a comprehensive cross-platform AR engine equipped with all of the features required by brands and developers to build AR experiences and apps. The MaxST platform promises competitive pricing combined with speed and ease of AR app development. The MaxST AR SDK provides the following functionality: instant tracking, visual SLAM (uses the smartphone camera to create a ‘virtual map’ of the surrounding area), object tracking, image tracking, marker tracking, and QR/barcode scanning functionality.
The MaxST AR SDK also provides a range of useful features such as cross-platform development capabilities, running on all major platforms including Mac OS, iOS, Android, Windows, and Unity 3D.
8.) Pikkart AR SDK
The Pikkart SDK enables developers to create AR apps with what promises to be a lightweight, simple-to-use, quick, robust, and ‘computationally inexpensive’ on-device detection and tracking. With offices headquartered in Italy, Pikkart AR SDK has four pricing tiers, starting with a basic version that is completely free to use. The free version of Pikkart AR SDK equips developers with an unlimited number of local markers, one demo app (on either iOS or Android), and twenty cloud-based markers. For a fixed fee of €299, developers can access all of the features available in the free SDK with added email support for assistance and guidance on using the platform to optimal effect. The two premium pricing tiers, cloud recognition and cloud API (both costing €99 per month), provide a broad range of functionality including unlimited databases, 1500 cloud markers, email support, and cloud recognition.
The Pikkart SDK promises to enable developers to create highly engaging and immersive AR experiences that can be up and running on-device in a matter of minutes. The platform includes native plugins for iOS and Android and also integrates with existing Unity and Xamarin projects. The SDK also enables developers to add geolocated augmented markers in order to develop integrated navigation services.
9.) DeepAR
The DeepAR augmented reality SDK was originally created for app developers seeking to build high quality, fully mobile optimized, Facebook, and Snapchat style 3D-face lenses, masks, and special effects via iOS, Android, HTML5 and Unity. The DeepAR SDK is lightweight and quick to integrate into existing projects and supports a huge range of different lenses, effects, masks and filters for creating highly immersive consumer-facing AR apps and prototypes.
The DeepAR platform provides facial detection functionality to detect faces and facial characteristics. This is achieved by combining a variety of different data models with sophisticated machine learning in 3D. The DeepAR SDK possesses extremely precise and fast facial detection, combined with chin, eye and nose detection and is capable of detecting over 68 facial feature points at nearly 60 frames per second. The platform is heavily optimized to detect multiple faces in real-time via compatible smartphones and tablets.
DeepAR also possesses real-time emotion detection functionality, capable of detecting all of the core human emotions: anger, disgust, fear, happiness, sadness, surprise (and neutral).
Conclusion
If you’re a student like me, a business or a brand thinking about how to develop an augmented reality initiative, there’s never been a better time to get started. As the technology becomes increasingly sophisticated and the capabilities of new SDK’s start to rapidly expand, the number of commercial opportunities associated with AR also start to increase. If you haven’t already, it’s worth taking some time to consider the marketing elements of your project.
Resources :
youtube.com/user/vuforia
