A Hand Gesture Sign Language to Text Real Time Interpreter using Google Mediapipe Artificial Intelligence

Riaz Sulaimi
8 min readSep 6, 2022

Introduction

5% of the world is deaf which means that 360 million people are deaf in the world. Some are both deaf and mute.

As one of the teachers in-charge of the school’s Innovation Program, we often facilitate discussion with the innovation program students on projects that they want to research on and the purpose of choosing that particular project to embark on that academic year.

In 2021, a team of students from the Innovation Program embarked on a project which involves converting gestures and sign language into text with the intention to help people with speech and hearing disabilities become more understandable.

Most people do not understand sign language, which is what the hearing impaired or the mute rely on most for communication with others.

This project is aimed at innovating a device to help those without the knowledge of sign language to communicate with this group of people.

Problem Statement

How might we improve communication between the hearing-impaired or mute by using a real time visual hand gesture/sign language to text interpreter?

What are hand gestures & Sign Language?

--

--

Riaz Sulaimi
Riaz Sulaimi

Written by Riaz Sulaimi

Riaz Sulaimi 👉Educator and Techie. I analyze Consumer Tech & Platforms and talk about STEM Education, Entrepreneurship, Technology & Design.