Fair Bytes
Published in

Fair Bytes

New Way to Measure Crowdsourcing Bias in Machine Learning

An overview of how to use counterfactual fairness to quantify the social bias of crowd workers

Photo by Edwin Andrade on Unsplash

Crowdsourcing is widely used in machine learning as an efficient form of annotating datasets. Platforms like Amazon Mechanical Turk allow researchers to collect data or outsource the task of labelling training…

--

--

--

A Medium publication sharing byte-sized stories about research, resources, and issues related to fairness & ethics of AI

Recommended from Medium

Multi-worker distributed Tensorflow training on Google Cloud AI Platform

March Madness Analysis Pt. 1

Ridge Regression

Data-driven Decisions for the New Way of Working

Estimating Possibly Undetected COVID-19 Infection Cases

My first experience as Data Science Intern at LetsGrowMore

Get Up-to-date Company Data Using This API

Dogs, Wolves, Data Science, and Why Machines Must Learn Like Humans Do

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Catherine Yeo

Catherine Yeo

Computer Science @ Harvard | I write about AI/ML in @fairbytes @towardsdatascience | Storyteller, innovator, creator| Visit me at catherinehyeo.com

More from Medium

Announcing VESSL for Academics

Case Study: Querying a Video Dataset Using Explainable A.I.

How to Train Machine Learning Algorithms For Ecommerce

How artificial intelligence can help fintech to detect credit card fraud?