Structural Shortcuts Compromise Automated Interpretability Evaluation Data
October 30, 2026
Evaluation pipelines for sparse-autoencoder (SAE) features contain structural biases that allow scoring without reading explanations. On GPT-2 small features, a simple rule checking if the center token is marked achieved 0.979 balanced accuracy, significantly outperforming existing LLM scorers.
HOW THIS AFFECTS YOU
●
researcherYou should re-evaluate interpretability benchmarks to ensure they are not inadvertently measuring pattern matching in dataset cropping.