Descriptive Language Understanding to Identify Potential Bias in Text

Ishan Shrivastava
Sep 3 · 8 min read
Image for post
Image for post

In order to facilitate meaningful change, we need to be aware and mindful of where that change is needed. — Lane Schechter, Product Manager, GumGum Inc.

GumGum’s Product Offerings

Approach for Descriptive Language Understanding Associated with Gender

Image for post
Image for post
Fig 1: Flowchart diagram describing the approach for Descriptive Language Understanding Associated with Gender
Image for post
Image for post
Fig 2
Image for post
Image for post
Fig 3: Word Cloud Based on Adjectives used around Male’s with Negative Sentiment
Image for post
Image for post
Fig 4: Word Cloud Based on Adjectives used around Female’s with Negative Sentiment

Nothing stereotypical stands out here. It has similarly or equally negative adjectives being used around Males and Females alike.

Image for post
Image for post
Fig 5: Word Cloud Based on Adjectives used around Male’s with Positive Sentiment
Image for post
Image for post
Fig 6: Word Cloud Based on Adjectives used around Female’s with Positive Sentiment

What we see here is that more Intellectual Type Adjectives being used around Males, while more Appearance Type Adjectives being used around Females.

Image for post
Image for post
Fig 7: Most Frequent Adjectives used for Only Male/Female based on top 15 Adjectives for each Gender corresponding to different Sentiment Context

Context Based Similarity Score

Image for post
Image for post
Fig 8: Calculating the Context Based Similarity Score from Contextualized Word Vector Representations of the Adjectives used around only Males and around only Females.

The higher this score, the better is the balance between the Adjectives being used around a particular gender in the context of a given sentiment and given IAB vertical.

Image for post
Image for post
Fig 9: The Context Based Similarity Score based on the most Frequent Adjectives used around Only Males and Only Females corresponding to different Sentiment Context

Conclusion


gumgum-tech

Thoughts from the GumGum tech team

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch

Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore

Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store