Position Bias Mitigated by Scale and Chain-of-Thought Prompting
October 19, 2026
A cross-lingual study across model scales from billions to trillions of parameters reveals that position bias affects small-scale and non-English models most heavily. Increasing model scale and employing standard Chain-of-Thought prompting significantly mitigates these biases in retrieval and multiple-choice tasks.
HOW THIS AFFECTS YOU
●
builderYou can improve RAG reliability by using larger models or CoT prompting to counter position bias.
●
researcherThis provides a comprehensive baseline for how model scale impacts linguistic and positional vulnerabilities.