MIT Scholar Finds Racial Bias in Commercial Facial Analysis Programs

A new study by researchers at the Massachusetts Institute or Technology and Stanford University finds that commercially released facial analysis programs demonstrate both skin-type and gender biases.

The study found that  the computer programs had a very low error rate when determining the gender of light-skinned men. But one program had an error rate of 20 percent in determining the gender of dark-skinned women. The other two programs had an error rate of more than 34 percent when asked to identify the gender of dark-skinned women. For women who had the darkest skin, the systems failed to accurately determine their gender nearly half the time.

The findings raise questions about how today’s neural networks, which learn to perform computational tasks by looking for patterns in huge data sets, are trained and evaluated. Joy Buolamwini, a researcher in the MIT Media Lab states that “what’s important here is the method and how that method applies to other applications. The same data-centric techniques that can be used to try to determine somebody’s gender are also used to identify a person when you’re looking for a criminal suspect.”

Buolamwini is a graduate of the Georgia Institute of Technology, where she majored in computer science. She earned a master’s degree at the University of Oxford as a Rhodes Scholar and is currently at work on a Ph.D. at MIT.

A video about the research can be viewed below.

Related Articles

1 COMMENT

  1. I found this video informative, but not surprising. I used to be a TV associate Producer many years ago and one of the problems in newly integrated stations was making sure the color balance showed dark skinned reporters to their advantage.

    Inexperienced white photographers sometimes did an entire news report with the reporter as a featureless sillohette because they had not balanced the color on their camera.

    Years have passed and now I am a Senior Lecturer in France where I teach English and do LanguageTesting.

    I was surprised by the new ETS (TOEIC, TOEFL…) rule that you must photograph test candidates on a light background which of course would make dark skinned people unrecognizable given the poor quality of the cameras.

    Am I correct in thinking that based on what you have said about present technology based décisions, the making of this regulation stems from ignorance?

Leave a Reply

Get the JBHE Weekly Bulletin

Receive our weekly email newsletter delivered to your inbox

Latest News

California State University Sacramento Launches Black Honors College

Officially launching for the fall 2024 semester, the Black Honors College will support students from all backgrounds who study Black history, life, and culture by providing them with a specialized curriculum and mentoring opportunities.

Higher Education Gifts or Grants of Interest to African Americans

Here is this week’s news of grants or gifts to historically Black colleges and universities or for programs of particular interest to African Americans in higher education.

In Memoriam: Norman B. Anderson, 1955-2024

Dr. Anderson was the assistant vice president for research and academic affairs at Florida State University at the time of his death. He had an extensive career in clinical psychology, which led him to become the first African American chief executive officer of the American Psychological Association.

Georgia State University Launches Program to Support Black Women in Tech

While Black women account for roughly 29 percent of the Georgia State University undergradaute student body, they represent only 10 percent of the university's computer science majors and 18 percent of the computer information systems majors.

Featured Jobs