A quick demo of Ashford

Ashford: An always listening assistant (2016)

Aaron Ng
Aaron Ng
Mar 5, 2017 · 2 min read

Around Thanksgiving 2016 I designed and built out a little always-listening personal assistant for my phone that would constantly be scraping my IRL conversations for data. Something that could just listening all day as I moved about with my Airpods (this was built out in anticipation of the AirPods release).

Idea

The conceptual ideal centered around Ashford eventually knowing what information to pre-emptively send to your phone, without you taking any action or you explicitly commanding anything. It knows who you need to meet, and when. It has all the things you need to remember (like phone numbers, emails, and so on) saved and pushes them to you at relevant times.

Actual Product

Eventually I got Ashford working to a point where it’d automatically save things like phone numbers, addresses, and reference numbers as I said them with a push to confirm. It could also define complex words without intervention. It just listens as I speak with my phone tucked away in my pocket and if it picks up on something relevant, saves it and sends me a push. If it picks up on something esoteric, defines it and sends me a push with the definition.

Some Details

The service was codenamed Ashford (later changed to Apollo) and consisted of a Django backend that handled all the querying, recommendations, logic, and auth stuff. Entity queries were done with Wikipedia as a primary source and WordNet (via PyDictionary) as a fallback for dictionary definitions.

Transcription was handled by Google’s Cloud Language API– streamed from the iOS app (written in Swift 3).

A few screens from Ashford, though the rightmost screen is really the only ‘core’ screen.

Current Status

Ashford is currently just a (fragile) toy that I poke at once in a while– it has many hurdles to overcome if I want to actually release it in the App Store (which I have no plans on doing). If it weren’t rejected outright by App Review, it’d (with current technology) probably decimate the battery life of both your AirPods and your phone. It’s something I’ll probably iteratively keep improving over time for fun.

Aaron's Blog

Aaron Ng's Medium

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store