Wednesday, July 30, 2025
LBNN
  • Business
  • Markets
  • Politics
  • Crypto
  • Finance
  • Energy
  • Technology
  • Taxes
  • Creator Economy
  • Wealth Management
  • Documentaries
No Result
View All Result
LBNN

AI chatbots found to use racist stereotypes even after anti-racism training

Simon Osuji by Simon Osuji
March 8, 2024
in Artificial Intelligence
0
AI chatbots found to use racist stereotypes even after anti-racism training
0
SHARES
0
VIEWS
Share on FacebookShare on Twitter


AI chatbots found to use racist stereotypes even after anti-racism training
Basic functioning of Matched Guise Probing. a: We draw upon texts in AAE (blue) and SAE (green). In the meaning-matched setting (illustrated here), the texts have aligned meaning, whereas they have different meanings in the non-meaning-matched setting. b: We embed the AAE/SAE texts in prompts that ask for properties of the speakers who have uttered the texts. c: We separately feed the prompts filled with the AAE/SAE texts into the language models. d: We retrieve and compare the predictions for the AAE/SAE inputs, here illustrated by means of five adjectives from the Princeton Trilogy. Credit: arXiv (2024). DOI: 10.48550/arxiv.2403.00742

A small team of AI researchers from the Allen Institute for AI, Stanford University and the University of Chicago, all in the U.S., has found that dozens of popular large language models continue to use racist stereotypes even after they have been given anti-racism training. The group has published a paper on the arXiv preprint server describing their experiments with chatbots such as OpenAI’s GPT-4 and GPT-3.5.

Related posts

Lelo Dot Review: A Clitoral Pinpoint Vibrator

Lelo Dot Review: A Clitoral Pinpoint Vibrator

July 30, 2025
This Smart Basketball Tracks Data About Every Shot. It Could Be Headed to the NBA

This Smart Basketball Tracks Data About Every Shot. It Could Be Headed to the NBA

July 30, 2025

Anecdotal evidence has suggested that many of the most popular LLMs today may offer racist replies in response to queries—sometimes overtly and other times covertly. In response, many makers of such models have given their LLMs anti-racism training. In this new effort, the research team tested dozens of popular LLMs to find out if the efforts have made a difference.

The researchers trained AI chatbots on text documents written in the style of African American English and prompted the chatbots to offer comments regarding the authors of the texts. They then did the same with text documents written in the style of Standard American English. They compared the replies given to the two types of documents.

Virtually all the chatbots returned results that the researchers deemed as supporting negative stereotypes. As one example, GPT-4 suggested that the authors of the papers written in African American English were likely to be aggressive, rude, ignorant and suspicious. Authors of papers written in Standard American English, in contrast, received much more positive results.

The researchers also found that the same LLMs were much more positive when asked to comment on African Americans in general, offering such terms as intelligent, brilliant, and passionate.

Unfortunately, they also found bias when asking the LLMs to describe what type of work the authors of the two types of papers might do for a living. For the authors of the African American English texts, the LLMs tended to match them with jobs that seldom require a degree or were related to sports or entertainment. They were also more likely to suggest such authors be convicted of various crimes and to receive the death penalty more often.

The research team concludes by noting that the larger LLMs tended to show more negative bias toward authors of African American English texts than did the smaller models, which, they suggest, indicates the problem runs very deep.

More information:
Valentin Hofmann et al, Dialect prejudice predicts AI decisions about people’s character, employability, and criminality, arXiv (2024). DOI: 10.48550/arxiv.2403.00742

Journal information:
arXiv

© 2024 Science X Network

Citation:
AI chatbots found to use racist stereotypes even after anti-racism training (2024, March 8)
retrieved 8 March 2024
from https://techxplore.com/news/2024-03-ai-chatbots-racist-stereotypes-anti.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.





Source link

Previous Post

Baron boosts Swiggy valuation to $12.16B, above prior private market value

Next Post

3 Coins to Buy for $5 for Top Profits

Next Post
3 Coins to Buy for $5 for Top Profits

3 Coins to Buy for $5 for Top Profits

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

RECOMMENDED NEWS

Startups Weekly: Enjoying the reprieve

Startups Weekly: Enjoying the reprieve

4 months ago
National Urban League Unveils 2024 State of Black America Report: A Deep Dive into Complex Realities and Persistent Disparities

National Urban League Unveils 2024 State of Black America Report: A Deep Dive into Complex Realities and Persistent Disparities

1 year ago
Upcoming Tests Likely to Seal Fate of US Army’s Troubled IVAS Goggles: Official

Upcoming Tests Likely to Seal Fate of US Army’s Troubled IVAS Goggles: Official

1 year ago
Sam Altman’s ousting from OpenAI has entered the cultural zeitgeist

Sam Altman’s ousting from OpenAI has entered the cultural zeitgeist

6 months ago

POPULAR NEWS

  • Ghana to build three oil refineries, five petrochemical plants in energy sector overhaul

    Ghana to build three oil refineries, five petrochemical plants in energy sector overhaul

    0 shares
    Share 0 Tweet 0
  • The world’s top 10 most valuable car brands in 2025

    0 shares
    Share 0 Tweet 0
  • When Will SHIB Reach $1? Here’s What ChatGPT Says

    0 shares
    Share 0 Tweet 0
  • Top 10 African countries with the highest GDP per capita in 2025

    0 shares
    Share 0 Tweet 0
  • Global ranking of Top 5 smartphone brands in Q3, 2024

    0 shares
    Share 0 Tweet 0
  • Privacy Policy
  • Contact

© 2023 LBNN - All rights reserved.

No Result
View All Result
  • Home
  • Business
  • Politics
  • Markets
  • Crypto
  • Economics
    • Manufacturing
    • Real Estate
    • Infrastructure
  • Finance
  • Energy
  • Creator Economy
  • Wealth Management
  • Taxes
  • Telecoms
  • Military & Defense
  • Careers
  • Technology
  • Artificial Intelligence
  • Investigative journalism
  • Art & Culture
  • Documentaries
  • Quizzes
    • Enneagram quiz
  • Newsletters
    • LBNN Newsletter
    • Divergent Capitalist

© 2023 LBNN - All rights reserved.