Aira.IO: a Cloud-Connected Wearable Providing Greater Independence for the Blind

AWS Startup Spotlight

AWS Startups
Aug 13, 2015 · 7 min read

The AWS Startup Spotlight series features startups all over the world building innovative, disruptive businesses on top of cloud infrastructure.

By Suman Kanuganti, Co-founder and CEO of Aira.IO

Aira.IO, based in San Diego and launched in 2014, focuses on developing technology and services that provide blind and low-vision individuals greater mobility and independence. Using wearable smart glass technology, Aira connects the visually impaired in real time (through AWS components) with remote, trained Aira Agents. Agents assist users to perform a myriad of daily activities — ranging from navigating city streets and catching a plane to ordering meals from a restaurant menu.

Inspiration From a Blind Friend

Those conversations resulted in Yuja (who is now co-founder of Aira and our VP of Product Management) and I working with other members of our Aira team to develop a viable prototype that combined Google Glass with personalized assistance from remote agents. This was the beginning of Aira, which we continued to nurture through the Lean Startup concept, in-depth market/technology research and testing, and best practices.

Larry Bock, the noted serial entrepreneur and venture capitalist, was another key addition to the Aira team. I first met Larry last year while demonstrating our product at a Foundation Fighting Blindness event. Larry, who is visually impaired, was enthralled by the potential of the Aira platform. He joined us recently as the Aira Executive Chairman.

How the Platform Works

  • The Aira platform pairs wearable smart glass devices with a user’s smart phone, which requires data connection from major network providers.
  • To connect with an Aira agent, blind or low-vision users simply tap their smart glass, and the Aira platform running in the AWS cloud sends an incoming request to Aira trained agents through an Uber-style routing algorithm.
  • Once the incoming request is accepted, on a dashboard the agent will see what the user sees with <1 second latency, while receiving real-time streaming updates to Google Maps, GPS, Street View, object/face recognition, step/distance readings, barrier warnings, machine-learning algorithms, and other data.

Aira’s Platform: What It Means for the Blind

Through the dynamics of the Aira platform, our product and services will also address a pressing socioeconomic problem: enhancing cost savings and productivity associated with the visually impaired. The results can be substantial when you consider that in the U.S. alone there are approximately 20 million blind and low vision people, and the economic loss due to vision problems is estimated at $135 billion annually. Approximately $56 billion of the latter figure represents how much the nation loses in productivity each year due to vision problems related to employment and travel, and money spent on assistive devices and programs.

Isn’t IoT, the Cloud, and Web Tech Awesome?

Image for post
Image for post

Although our platform provides most of the business logic, we leverage Wowza for real-time streaming and JW Player for playback in real-time.

Let’s look at this more closely with our components in the picture:

  • On the user’s end, Google Glass uses libstreaming library and pushes RTSP streams. All of our servers, including Wowza servers, are hosted on AWS EC2 instances. Wowza works great if you are in the IoT space and want to quickly get streaming from any IP camera. It supports multiple transformations between streaming protocols out of the box.
  • Our dashboard is entirely developed in HTML5/JavaScript, hosted in Amazon S3. Amazon CloudFront provides a responsive dashboard to our distributed agents across the country. We optimize these streams for network latency with less than 1 second buffer length.
  • Our platform runs on Tomcat EC2 instances, and handles the JSON payloads over an HTTPS endpoint.

The platform synchronizes, based on the timestamp of sensor data, with video frames. This synchronization plays a critical role for our agents. This is a key element for our IoT integration. A unique hash identifies the metadata required to indicate where the payload is coming from, delivering a synchronized view of live video and sensor UI elements to the dashboard.

Thanks to connected services and open APIs, our platform integrates and pulls relevant information from Google Maps, Uber, Indoor Maps, Yelp, OpenWeather, NextBus, and several other cloud sources.

All of these elements contribute to building the “surrounding context” of the user. Here is our high level architecture:

Image for post
Image for post

Unlike Netflix, where a few seconds of delay is acceptable and caching works really well, in our case any frame that is 5 seconds old is useless to us; we just throw it away. So, we are working further to solve this issue for real-time, smooth streaming in low-latency networks.

Why AWS is Our Obvious Choice

More important, the list of AWS services is comprehensive. Who doesn’t want all their cloud services managed in one place, resulting in greater economies of scale? Amazon CloudFront makes our dashboard responsive. Amazon Route 53 allows us to choose the best route for low latencies. Wowza EC2 optimized instances, which are readily available on AWS Marketplace, makes scaling of our streaming servers a breeze. Our engineers’ passion for Chef to bootstrap and automate AWS components makes our development lifecycle faster and our operations more efficient. In addition, we appreciate the technical support we receive from AWS when we get blocked, and the advice and reviews from AWS architects. Our deployment architecture is depicted in the following diagram:

Image for post
Image for post

Here are just a few other key advantages of AWS that Aira enjoys:

  • AWS is a one-stop for not only our infrastructure needs (computing, storage, and load-balancing), but also out-of-the box services such as Identity and Access Management (security), Amazon RDS (databases), API Gateway (API management), and Amazon CloudWatch (monitoring).
  • AWS is more than a cloud provider for us. We don’t have to solve the problem of database scaling, and we rely heavily on CloudWatch and Amazon SNS for our monitoring needs.
  • AWS is one of the few services that actually advises you about how you can optimize your usage of resources and save money. For example, we got an email about our S3 utilization. We were storing builds in S3 that were not accessed in days. We followed the advice from AWS to use Amazon Glacier for such cases, which saved us money.

In fact, it has been our experience that AWS supports the startup community to a greater extent than other cloud service providers. If you are a startup and are already incubating at an accelerator, we highly recommend that you apply for AWS Activate, or consult your incubation coordinator for further insight on the advantages of AWS.

Aira Moving Forward

Aira will be available as a monthly subscription model, including the service and device, starting in early 2016 after beta trials for the product are completed this summer.

Looking ahead, Aira also envisions expanding into other healthcare markets (e.g., dementia, autism) that need remote assistance.

AWS Startup Collection

For startups building on AWS.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store