Fifteen Unconventional Uses of Voice Technology

From a heartbroken Google Home to talking plants

Nicole He
Nicole He
Nov 26, 2018 · 4 min read
Objects summoned in VR by voice in Aidan Nelson’s “Paradise Blues”

I recently taught a 7-week long, Master’s-level course at NYU’s Interactive Telecommunications Program called Hello, Computer: Unconventional Uses of Voice Technology.

The goal of the class was for students to learn the technical skills to work with emerging voice technology, and use them to make artworks, games, apps or installations that were outside of the practical ways we currently talk to computers.

Students had half a semester to learn tools like the Web Speech API, Dialogflow and Actions on Google, and then were tasked with making something…interesting. The in-class code examples we used are on GitHub.

Here are fifteen funny, subversive, and impressively weird final projects from the class:

Sad Bunny is a digital representation Kimberly Lin made of herself, in the form of a sobbing, sniffling Google Home who you console through a recent break-up. Kim reverses the emotional labor dynamic between human and voice assistant, making you patiently listen to the intimate details of Sad Bunny’s romantic experience and give her advice.

Read Kim’s blog post here.

Itay Niv made BeatBot, which turns your typically dry computer-speak into sick beats. It’s a web-based speech synthesis sequencer that even raps on top of itself.

Yiyao Nie made the AR pet she wishes she could have in real life: a dog that listens to what she says, understands and reacts, responding to commands such as “sit” or “come” or “lay down”. While we still can’t cuddle virtual pets, shouting and having them come towards you from across the room might be the next best thing.

Read Yiyao’s blog post here.

Inspired by the experience of drinking soju with your buddies in Korea, Joohyun Park made Mystery Number, a version of a game where everyone has to guess the number that’s etched into a bottle cap. Appropriately, the computer voice you’re playing with sounds drunk.

Read Joohyun’s blog post here.

Mengzhen Xiao created the Geegle Assistant, which is very much like the Google Assistant, except for one thing: it has feelings. The Geegle Assistant can do all the normal functions you’d expect in a voice assistant, but it has a strong personality and isn’t shy about expressing disappointment in your behavior.

Read Mengzhen’s blog post here.

Maï Arakida Izsak uses Twitch comments to create a feeling of co-presence for someone in a VR headset. In VR Voicemail, Maï streams her scene in Twitch, allowing viewers to comment in the stream chat in real-time. When someone leaves a comment, a pink bubble falls into the scene. When Maï touches the bubble, the comment is read out loud in speech synthesis, and broadcast out again to the stream.

Read Maï’s blogpost here.

Aidan Nelson made Paradise Blues, a voice-controlled VR experience that makes you the god of your own personal hell. You say things like “Bring me 50 chickens!” or “Let there be refrigerators!” and the objects you summon rain dramatically from the sky until they pile up in a mess all around you.

Read Aidan’s blog post here.

Jenna Xu created an assistant to help in her own life, featuring a guided breathing exercise, guided physical exercise, guided cognitive behavioral therapy, and a gratitude log. By making a tool that intervenes with life’s common problems, Jenna uses Life Support to turn her self-care into a regular practice.

Read Jenna’s blog post here.

Ilana Bonder wanted to make something functional and genuinely useful for her daily life and the life of her fellow students, so she created the ITP Assistant. The ITP Assistant allows student to find a teacher who can help with specific topics, and then books office hours with them.

Read Ilana’s blog post here.

Makeup Guru, by Alice Sun, generates a fresh eyeshadow makeup lewk based on a color of your choice. The colors themselves are selected in an unusual way — from word vectors created from sorted RGB values. There are also some unconventional makeup colors in there, including “poo”, “baby puke green”, “snot shade”, and “diarrhea”.

Read Alice’s blog post here.

Alden Jones created Leaf Town, a device that lets him talk to his plants and hear them talk back to him. It’s a speculative fiction piece that imagines the inner life of his plants, who have to be wired up, because obviously plants can’t communicate using wifi and need to be connected by their roots.

Read Alden’s blog post here.

Nick Wallace, like many of us, needs a drink after a long day. He built Virtual Bartender, which asks you for your liquor of preference, and stirs up a cocktail recipe for you.

Shreiya Chowdhary created Wee Wee Piggy an twisted voice game version of the nursery rhyme “This Little Piggy.” You use voice commands to move the pig around the page, trying to get him home, but instead of saying “up, down, left, right,” you have to say “sausage, bacon, ham, chops.”

Read Shreiya’s blog post here.

For those of us who have suffered heartbreak, Ridwan Madon made Breakup Aid, an Google Assistant Action that helps you get through and recover from a breakup. The app is meant to be a companion that may be easier to talk to than another human being when you want to vent.

Read Ridwan’s blog post here.

Keerthana Pareddy made Feed Me The Buzz, which is her voice-only version of the ubiquitous Buzzfeed personality quizzes. Using generative text techniques, the app asks you 10 questions, ultimately then telling you the next fake Buzzfeed article you should read.

Read Keerthana’s blog post here.

Hello, Computer’s class syllabus can be found here, and the in-class code examples taught can be found here.

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store