Published in


3+ Ways AI and Design intersect (and Designers can get involved with AI)

Pointing out the spaces & practices emerging at this intersection.

Shaping the world around us

The role of a designer is to intentionally shape the world around us with the resources we have available. That world is increasingly shaped by data sets, algorithms, and pre-trained models.

As Artificial Intelligence(AI)/Machine Learning(ML) is finding its way into every industry and area of life, we can no longer afford to limit the development of these systems to the domain of engineering. As people are widely affected, both positively and negatively, we no longer get to excuse ourselves because it’s ‘too’ technical.

You may ignore technological developments and continue your design practice as-is for now. But if you recognize the influence and responsibility we have as designers or are simply curious to learn what AI and design have to do with one another, you came to the right place.

How do AI and design intersect?

While still in its infancy, the intersection of AI/ML and design is beginning to take shape and establish itself as a field. Universities form research groups and big tech expert teams committed to it. And as AI/ML is increasingly widespread, the need for designers to ensure the human(ity)-centeredness of these systems is urgent. The other day I even came across the first job opening for “AI designer”, and then another one — so yes, I guess it’s a real thing now.

Right now, I’m observing 3 major opportunity spaces for designers to work with AI/ML:

  1. design with AI (human-machine collaborations with creative output)
  2. design for AI (integrating human-centered design practices into the AI dev process)
  3. design of AI (interaction and UX design for AI systems)

We’ll discuss each of these in more detail.

1) Design with AI — human-machine collaborations with creative output. AI as a design tool or partner.

How can AI assist us in the creative / design process? Design with AI is exploring collaboration between human creativity and computational logic to produce creative output. Creatives have begun exploring the abilities of AI to augment their images, videos, text, music, UI, product design, architecture, and any other format that can be rendered into computable data.

This practice seems most relevant for graphic designers, artists, and creatives.

Examples of what Design with AI might look like in the wild:

  • generative or parametric design in architecture like Autodesk did to design their new Toronto office
  • automating tedious design tasks like AirBnB’s tool for digitalizing wireframes or Netflix’s tool for localizing graphics
  • logo and brand asset generation tools that have learned from best practices for example from Brandmark
  • using machine learning models such as PoseNet and mapping its prediction to visual output like this collaboration by technologist Maya Man and dancer Bill T. Jones
  • Generative Adversarial Networks (GANs) to generate images imitating or warping a certain input style. Try the Ganbreeder yourself
  • Vera van der Seyp is one of my favorite AI designers working with generative type and graphics
  • Sofia Crespo is an AI artist focused on nature & neural nets

Resources to learn more about Design with AI: — incredible directory of AI x design projects
Runway ML —the easiest way to get started with creative AI
AI Artist’s AI Art Tools — exhaustive collection of creative AI tools — set of AI-powered design tools

Questions to ask and ponder around Design with AI:
Continuing a similar debate around intelligence, how do we define and measure creativity? Who owns, gets to take credit, and sells the art when it’s made in collaboration with an AI, from an often pre-existing dataset, and open-source model? Should we use computers to imitate best practices or incorporate randomness instead?

Image created using CLIP+VQGAN model to generate visuals based on text prompts

2) Design for AI — integrating human-centered design practices into the AI development process. AI as a problem-solver.

Why, when, and how should we build AI systems? Design for AI is about bringing elements and practitioners from the human-centered design approach into the AI development process. Spotting opportunities, considering user needs, and anticipating societal implications alongside engineering decisions will enable us to build systems that are considerate of the context they’re intended for. This requires a close and cross-disciplinary collaboration between designers and engineers.

This practice seems most relevant for design consultants, strategists, and researchers.

Examples of what Design for AI might look like in the wild:

  • Spotting opportunities for AI/ML to add value and help solve problems in a unique way
  • Being able to frame user needs as data exploration queries and machine learning problems
  • Informing trade-offs between different algorithms and optimization parameters based on the specific use case (e.g. recall vs precision)
  • Prototyping the experience through Wizard of Oz methods to validate user value before investing lots of resources
  • Interviewing domain experts for an early understanding of feature selection and decision logic

Some resources to learn more about Design for AI:
AI meets Design toolkit — my toolkit for designers to work with AI
AI Ideation Cards — card deck with 24 prompt cards and 100+ examples to help you brainstorm around AI capabilities and find opportunities
Lingua Franca — A Design Language for Human-Centered AI

Questions to ask and ponder around Design for AI:
What do designers need to learn about AI/ML? What do engineers need to learn about design? How can we make the most of both designers’ and engineers’ practice? How do we communicate and collaborate to design human(ity)-centered AI?

AI Ideation Card deck to support in finding meaningful opportunities for AI

3) Design of AI —shaping the UX, UI, and user interaction with AI systems. AI as a design material.

How will users interact with the AI systems we built? Design of AI is about designing interactions with adaptive, intelligent, and semi-autonomous systems. Every design material comes with unique opportunities and challenges. In the same way that designing an event poster is different from designing a mobile app, designing AI/ML-driven applications is different to designing mobile apps. To create helpful and holistic experiences, this requires designers to acquaint themselves with the materiality of data and AI/ML, and coin smart solutions.

This practice seems most relevant for UI, UX, and interaction designers.

Examples of what Design of AI might look like in the wild:

  • Leveraging new types of interactions available such as voice interfaces and computer vision for better user experiences
  • Designing interfaces to explain to users (with the right amount of detail) how the system works
  • Laying out an ongoing onboarding process that makes sense of changes
  • Building in the right user feedback mechanisms both implicit and explicit to help your model learn
  • Auditing datasets and models for inclusivity and bias
  • Anticipating potential unintended consequences

Some resources to learn more about Design of AI:
AI-Driven Design Ebook #4 — Design Challenges in Machine Learning Products — my ebook with AWWWARDS & Adyen about some of the unique design challenges

Questions to ask and ponder around Design of AI:
What are helpful mental models for users to have around understanding AI/ML-systems? How do we materialize high-level principles like explainability and user feedback loop into (post-pixel) interfaces? How can we build responsibility and ethics audits into every step of the development process to anticipate consequences and ensure inclusivity?

Image from SPACE10’s Everyday Experiments proposing a speculative computer vision chef

4) Design x AI

There are plenty more practices and design challenges surrounding AI/ML. While these may not fit into the categories above, they’re relevant spaces for us designers and this post wouldn’t be complete without mentioning them.

  • Data Design
    On the periphery, we observe a practice that is less about AI/ML and more about the raw material it feeds off: data. This includes data visualization, data design, information design, even database design. For example Giorgia Lupi’s work.
  • ML Tools
    With more low- and no-code tools entering the market, somebody is designing the applications that allow people to train, test, and deploy machine learning models through Graphical User Interfaces instead of code. For example Teachable Machine, AutoIBM, or RunwayML.
  • AI Education
    One of the most important roles in this whole space is developing accessible educational content and experiences to improve data literacy and make AI/ML understandable to professionals and the general public.
  • … tell me what else is emerging in the comments!
Image from the project Explainable Artificial Intelligence: a Collection of Critical Essays

Forming a taxonomy around AI x Design

A very young field, this is a first attempt at forming some sort of taxonomy to organize the practices emerging at this intersection. It’s by no means complete or decided — rather, it’s here for you to argue and add onto! I’d love to hear from you with more examples, new categories, and alternate mental models.

Join the AIxDesign community

AI and design have a lot more to do with each other than a first glance may suggest. As a development that is so influential, it’s of crucial importance more designers, artists, social scientists, and hybrid minds work alongside the engineers building these systems.

That includes you! If you’re feeling in any way triggered, consider this a call. Get lost in some of the resources, ask your engineers if you can help, run off to make some weird AI art. Whatever it is, take that first step.

If you (want to) work in the AIxDesign space, I invite you to join our community of AIxDesign practitioners. We host events, publish content, congregate in a Slack channel, share opportunities, facilitate networking spaces, and more.

There’s so much to be done and this is just the beginning. I’m excited and honored to see it all unfold and contribute where I can.

I’d love to hear if you learned anything new, and what (if any) next steps you’re planning to take!


There are new practices emerging at the intersection of AI and design. For now, they seem to fall in 3 categories: 1) design with AI (creative human-AI collaboration), 2) design for AI (human-centered design for the AI dev process) and, 3) design of AI (interaction and UX design for AI systems). With plenty more practices popping up at the periphery, this young but rapidly growing field offers exciting opportunities for designers to get involved and make an impact.




Exploring practices at the intersection of AI/ML and design.

Recommended from Medium

The future of Object Detection

What Is Artificial Intelligence and What’s The Future of AI?

Does Uncle Sam Really Want You?

Algorithm Regulations: Escaping the Stringent Control System

SimInsights Launches HyperSkill Platform, an AI-Powered No-Code eXtended Reality SaaS Platform

Game Level Design with Reinforcement Learning

Fuzzles Landing Soon

Is it possible to “upload” a human mind on a silicone substrate?

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Nadia Piet

Nadia Piet

Designer & researcher focussed on AI/ML, data, digital culture & the human condition mediated through computing

More from Medium

7 new skills to learn for conversation designers in 2022

Right Thing, Right Design, Right Data

Stop light with green right turn arrow illuminated.

Product Innovation Through Collaborative Intelligence of Human and AI

UX and Artificial Intelligence.