LLM-as-a-Judge Shows Gender Bias in Professional Candidate Evaluations
November 3, 2026
Analysis of eight LLMs using NVIDIA's Nemotron-Personas reveals that explicit candidate gender labels increase Yes-vote probability by up to 1.73 percentage points. Decisions reversed for up to 3.3% of cases compared to unspecified-identity baselines, even when identity matching was not present.
HOW THIS AFFECTS YOU
●
builderYou should implement debiasing checks when using LLMs as judges for professional tasks.
●
policyYou must account for demographic sensitivity when deploying LLMs for automated recruitment or evaluation.