Analyzing Option Bias via Pooled Selection-Rate SD
October 13, 2026
This analysis connects selection bias and order sensitivity in multiple-choice evaluations through a metric called pooled SD. The study demonstrates how the flip rate and positional skew determine the unevenness of option selection across 41 checkpoints.
HOW THIS AFFECTS YOU
●
researcherYou can better understand and quantify how much your evaluation benchmarks are skewed by option ordering.