Control Alexa With Your Eyes

Hackster Staff
Feb 23, 2017 · 2 min read

Smart home devices like Amazon Echo or Google Home may be easy for most people to use. But for those suffering from motor neuron diseases such as amyotrophic laterals sclerosis (ALS), also known as Lou Gehrig’s disease, producing speech to command the system can present a seemingly insurmountable barrier.

(📷 GazeSpeak, Enable Team, Microsoft Research)

However, there is now a workaround, as Jay Smith shows in the video below. Using Microsoft’s GazeSpeak app, he’s able to translate his eye movements into computer-generated speech. This speech is then picked up by Amazon’s Alexa to modify room conditions such as what lights are on, or what song is playing.

I have ALS so I am mostly paralyzed and use my eyes to communicate. I have a smart home and now can use my eyes to type commands through my Microsoft Surface. It works with my Wemo light, fans, Ecobee thermostat, and more.

In a related project, seen in the second video here, he even has a bed that can be controlled via his eyes. The system uses an Arduino-compatible RedBear Blend Micro to translate his eye movement into the needed infrared signals.

UPDATE: Most recently, Smith has created system with Arduino and custom software that enables him to maneuver his wheelchair around using his eyes through a Microsoft Surface.

Hackster Blog

Hackster.io, an Avnet community, is the world’s largest network for hardware & software developers. With 1 million members and 17,000+ projects, beginners and professionals can learn and share how to build robotics, industrial automation systems, AI-powered machines, and more.

Hackster Staff

Written by

Hackster Blog

Hackster.io, an Avnet community, is the world’s largest network for hardware & software developers. With 1 million members and 17,000+ projects, beginners and professionals can learn and share how to build robotics, industrial automation systems, AI-powered machines, and more.

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade