LocAI: AI Design for Local Contexts

People + AI Research @ Google
People + AI Research
7 min readFeb 24, 2021

Through new co-creation and speculative design methodologies, the LocAI team explores the role of local context in AI product design.

Close-up of a hand writing, with expressive lines radiating from the pen to express ideas and brainstorming.
Illustration for Google by Shannon May

By Daniel Goddemeyer and Rob Marchant

Daniel Goddemeyer is an independent designer and consultant who works with companies to envision future products that utilize the potential of data- and AI-driven technologies. He also teaches workshops using experiential methods that inspire product development with more nuanced, future-facing human perspectives. Rob Marchant is a program manager at Google AI, working on future-facing AI design projects.

The Challenge: AI and Cultural Context

AI-powered products are increasingly being deployed at global scale to support us in our everyday lives — from suggesting songs to helping us complete our text messages. Over time, many of these systems improve in their ability to support specific needs of individual users.

All users are different however, and once deployed, these products must adapt to unique individuals in a variety of situations and use cases that are specific to the user’s local environment — with its unique norms, values, belief systems and etiquettes.

In order to enable AIs that are highly mindful of cultural specifics, we need new methods to create more direct connections between users, AI designers and developers, and we need to raise awareness of local cultures throughout the product development process.

The LocAI Project

LocAI is a co-creation workshop series that investigates this challenge — particularly around the role of cultural context when designing future AI technologies.

It is aimed at design students and guides them through a process from research to concepting to design and, through the resulting work, highlights how local attitudes, aspirations and needs are being projected onto technology.

Participants are tasked with identifying possible use cases for AI assistance that exist within their immediate surroundings. They must then visualize these local AI futures (aiming for a timeframe of the next five years) and transform them into active learnings for the development of future assistive AIs.

With these exercises, LocAI aims to create an open, shareable methodology that — as a set of tools — allows designers to explore the use cases of an assistive AI within immediate local contexts and, through this, create a more direct connection between cultural specifics and global development.

Case Study: LocAI Singapore

We piloted LocAI in September 2019, with a group of students from Nanyang Polytechnic in Singapore.

Through a series of quick, successive sprints over the course of two weeks, the LocAI team, including Matt Jones, Principal Designer at Google AI, guided them through a design-focused AI research and design process. By focusing on exploring future possibilities for AI assistants that could support specific, local needs, students created future-facing design solutions that demonstrate how AI could be embedded into the everyday lives of Singaporeans.

The LocAI Process

01 Understanding the context

To get an initial feel for what distinguishes everyday life in Singapore, students started by identifying the distinctive local demographics, professions, use cases, quirks and issues.

Next, they spent a day researching in the field to observe and explore the group, topic or issue they were specifically interested in.

Collection of post-it notes with drawings that represent local professions with labels that say ice cream uncle, tissue auntie, lottery uncle, ma ma shop, buskers, traffic officer, rag and bone man, neighborhood member of parliament, neighborhood cleaners, hawker center, coffee auntie, pasan malam (night market).
Identifying the uniqueness of Singapore

02 Understanding the technology

After their initial field research, the students were guided through a series of exercises to understand the present workings and future potentials of AI.

The data we create

To grasp how our own data is the raw material for machine learning algorithms, we asked the students to take out their phones and draw the most used apps on their home screens.

For each app, they were asked to list the interactions they perform with it and the corresponding data that they think they leave behind through using the app.

Student holding up a drawing that represents the data he generates daily.
The data we create

AI associations

Students then had to call one of their parents live in class to see how they would define ‘AI’. This helped to get a feel for the diverse associations we have with AI, often heavily influenced by popular culture — and come to a unified definition to work with.

It provided a fun starting point, and helped to differentiate between fact and fiction — between realistic capabilities in the coming years and science fiction.

Room full of students on cell phones.
AI Associations — Call one of your parents to find out what they think AI is.

“The part where we all of a sudden had to call our friends or family to ask what is AI was my favourite activity. It was a pretty wild but interesting experience!” — Workshop participant

Knowing me, knowing you

Once the class arrived at a shared definition of what we commonly understand as AI, we followed up with an expert talk that equipped students with an initial understanding of the present and future potentials of AI.

Students then used this knowledge to build on the data portraits their fellow students had drafted.

Imagining they had a fellow student’s data for one year, they speculated what insights around their behaviors, interactions and daily routines could be derived from such data.

They then presented what they might learn about that student back to the class, “as seen” through the lens of their personal data and AI.

Drawings of a person’s daily data on a sheet of paper with post-it notes.
As seen through your data — Presenting your classmates through their data

03 Applying the technology through design concepts

Following a discussion around the nature of personal assistants and assistive intelligence in their local surroundings, students then started concepting what first use cases of an intelligent personal assistant in their immediate surroundings could be.

Two drawings of ideas for how to use AI to help parents, in the form of fake ads. One says “AI that understands your baby. Figure your baby out. Only $399. What? You haven’t stopped the baby from crying? You know it’s easy right? Our B-AI-BY knows!” and the other says “Text Strain — Only at $40. Real-life feeds, monitor them now, ability to erase data, switch on text straining!”
Thought starter exercise — Develop an AI for your parents that helps them to deal with you

“Coming up with something for your younger self was an interesting exercise to get the brain juice flowing. Fun that there were no restrictions.” — Workshop participant

Following a fun thought starter exercise where the students had to develop an AI for their parents to assist them in dealing with the students at their most annoying age, they then considered how a future, intelligent AI would be able to support their researched user group, and translate this into conceptual directions for future features and products.

In order to quickly test their hypothesis and manifest their ideas visually, students went through a quick exercise of creating one-page adverts, visualizing their concept and defining its main features.

Two ad mock-ups that visualize students’ AI concepts. One shows a bracelet and says “Not sure how to interact with your friend with autism? Fret not! with A-I GTG become able to predict what might trigger your friend! Tell your friend’s mood in a glance with a wide spectrum of colors!” The other shows an elderly man with a walker and says “The smart walker. Independence was never sweeter! Equipped with a GPS tracker, motion detection, and buddy locator etc.“
Prototyping AI products with quick ads

04 Prototyping concepts

Prototyping their ideas without any ‘actual’ AI at their disposal, students had to be creative in how they could let the class experience their ideas.

Simulating Intelligence through role playing, building quick mock-ups and involving their fellow students in live experiments, the initial ways of testing their ideas gave them quick insights and initial feedback.

A man wearing glasses and a woman wearing glasses and a headscarf work together to build a prototype with black pipes.
Students building prototypes
A classroom of students demonstrating an AI prototype. They are holding clear acetate sheets in front of their faces. Each sheet has a drawing of a frame with words above it — bored, engaged, intrigued.
Students building prototypes

05 Final projects

Finalizing their projects, students then developed visual scenarios, product mockups and images that exemplified how a future AI assistant would practically play out in the local context of Singapore.

From an AI supporting Singapore’s unique culture of tolerance between religions, ethnicities and demographics, to creating support systems for the interactions at local Hawker (Food & Drink Court) centers, to an AI supporting Singapore’s large population of migrant workers — their visual stories sparked new thoughts and discussions around an AI-assisted future in Singapore.

Although the students focused on their immediate surroundings, some of the resulting ideas such as an AI incentivizing recycling, or an intelligent stroller assisting elderly populations, were broadly applicable beyond the immediate context of Singapore.

Two examples of student projects. One shows a classroom of students from the perspective of someone presenting, with an AI overlay that shows each student’s state, such as confused or daydreaming, and overall engagement rate and tone. The other is a mock ad with a photo of a young man using a walker and a map overlay that shows his location on a map. It says “Look back at memories, find nearby friends, never get lost again with our GPS system, ASPI will guide you home. The smart walker.”
AI’fluent Presentation Support & ASPI Smart Walker
A woman’s hand holding a soda can and wearing a smart watch. The screen of the watch says “There is a recycling can near you. It only takes less than 2 seconds to…”
Recycl’AI — An AI encouraging recycling in Singapore

Reflection & Learnings

Running this initial workshop in Singapore, as with any pilot, some things worked better than others, and we certainly left with ideas for improvement, from extending the user research phase to adding new exercises.

Feedback from the students was extremely positive and the students left with new perspectives around the capabilities of AI and how these future AIs could assist people in their immediate surroundings.

Group photo of students and workshop moderators posing in front of a large Google logo.

Looking beyond this pilot, the LocAI project aims to continue to develop a replicable, participatory methodology that can allow anyone to explore the role of future AI assistants in their direct local context. Not only in a classroom-led scenario like in the pilot, but directly to designers and developers wherever they are.

Our hope is that LocAI creates new connections between local context and global product development and contributes to AI products that are more mindful of local aspirations, issues, hopes, needs and use cases.

--

--

People + AI Research @ Google
People + AI Research

People + AI Research (PAIR) is a multidisciplinary team at Google that explores the human side of AI.