Scholar Looks to Improve Data Science for Analyzing the Language Used by African Americans

Su Lin Blodgett, a graduate student in computer science at the University of Massachusetts, recently presented a paper at the annual meeting of the Association of Computational Linguistics in Melbourne, Australia. Her research is focused on improving English language parsing tools relating to words, phrases, and alternate spellings used by millions of African Americans on social media.

Current Natural Language Processing (NLP) tools “learn” and are trained on mainstream American English, and as a result don’t perform well on Twitter, where text deviates from this standard in many ways, including non-standard spelling, punctuation, capitalization, syntax and hashtags, the authors point out. They add that dialects such as African-American English, spoken by millions of individuals, contain language features not present in standard English.

By expanding the linguistic coverage of NLP tools to include minority and colloquial dialects, the thoughts and ideas of more individuals and groups can be included in areas such as opinion and sentiment analysis, Blodgett points out. For example, if a political campaign were to use a standard NLP tool to analyze opinions on Twitter, but did not capture what African-Americans are saying, the tools could be missing a significant portion of the electorate and could vastly misinterpret overall sentiment.

Related Articles

Leave a Reply

Get the JBHE Weekly Bulletin

Receive our weekly email newsletter delivered to your inbox

Latest News

California State University Sacramento Launches Black Honors College

Officially launching for the fall 2024 semester, the Black Honors College will support students from all backgrounds who study Black history, life, and culture by providing them with a specialized curriculum and mentoring opportunities.

Higher Education Gifts or Grants of Interest to African Americans

Here is this week’s news of grants or gifts to historically Black colleges and universities or for programs of particular interest to African Americans in higher education.

In Memoriam: Norman B. Anderson, 1955-2024

Dr. Anderson was the assistant vice president for research and academic affairs at Florida State University at the time of his death. He had an extensive career in clinical psychology, which led him to become the first African American chief executive officer of the American Psychological Association.

Georgia State University Launches Program to Support Black Women in Tech

While Black women account for roughly 29 percent of the Georgia State University undergradaute student body, they represent only 10 percent of the university's computer science majors and 18 percent of the computer information systems majors.

Featured Jobs