Are Algorithms Building the New Infrastructure of Racism?

How we use big data can reinforce our worst biases — or help fix them

Nautilus
Nautilus Magazine

--

Credit: karpenko_ilia/iStock/Getty Images Plus

By Aaron M. Bornstein

“We don’t know what our customers look like,” said Craig Berman, vice president of global communications at Amazon, to Bloomberg News in June 2015. Berman was responding to allegations that the company’s same-day delivery service discriminated against people of color. In the most literal sense, Berman’s defense was truthful: Amazon selects same-day delivery areas on the basis of cost and benefit factors, such as household income and delivery accessibility. But those factors are aggregated by ZIP code, meaning that they carry other influences that have shaped — and continue to shape — our cultural geography. Looking at the same-day service map, the correspondence to skin color is hard to miss.

Such maps call to mind men like Robert Moses, the master planner who, over decades, shaped much of the infrastructure of modern New York City and its surrounding suburbs. Infamously, he didn’t want poor people, in particular poor people of color, to use the new public parks and beaches he was building on Long Island. Though he had worked to pass a law forbidding public buses on highways, Moses knew the law could someday be repealed. So he built something far more lasting…

--

--

Nautilus
Nautilus Magazine

A magazine on science, culture, and philosophy for the intellectually curious