Data Science in R

How to Build a Neural Network Model to Understand Sign Language and Improve It Using Data Augmentation

Marvel’s Eternals brought me here

Table of Contents
· Library
· Dataset
· EDA & Preprocessing
· Metric and Validation
· Modeling
  ∘ Dense with 2 Hidden Layers
  ∘ Dense with 3 Hidden Layers
  ∘ Dense with Data Augmentation
· Conclusion

According to research by Preply, there’s been a 250% increase in searches for “learn sign language for beginners” in the past year. This interest in sign language is believed to be caused by newly introduced Marvel’s Eternals deaf superhero, Lauren Ridloff’s Makkari.

It’s good to join the trend and feel the hype. However, to be honest, I know nothing about sign language. But I know neural networks a bit. So I think, it will be fun to marry the two, right?

American Sign Language (ASL) is a complete, natural language that has the same linguistic properties as spoken languages, with grammar that differs from English. ASL is expressed by movements of the hands and face. It is the primary language of many North Americans who are deaf and hard of hearing but is used by many…