An evaluation of six local LLMs reveals consistent name-based biases regarding race, age, and gender. Using 300,000 responses from US Social Security Administration datasets, the study shows models demonstrate a preference for names that are older, white, and less stereotypically male.
HOW THIS AFFECTS YOU
●
researcherYou can use these findings to develop better debiasing techniques for demographic indicators in text.
●
policyThis highlights measurable risks in using local models for tasks involving sensitive demographic inference.