[arXiv]score: 0.28

Alignment Training Causes Probability Bias Against Protected Attributes

October 23, 2026

An analysis of OpenAI and Anthropic models reveals that alignment-driven refusals create a cost of declining information. In a Bayesian game, models treated information from Black-described reporters as worthless at rates up to 46% higher than other groups, regardless of evidence quality.

HOW THIS AFFECTS YOU

●

researcherThis provides empirical evidence of how standard alignment techniques can inadvertently introduce severe utility biases.

●

policyThis demonstrates a new class of algorithmic bias where safety training leads to the systematic exclusion of specific demographics.

read original ↗arxiv.org

DAILY DIGEST

you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy

← back to feed