Resolution Depth Predicts Human Reading Time Better Than Final Layer Surprisal
November 20, 2026
Measuring the layer where a model's prediction stabilizes, termed resolution depth, improves human reading time prediction by 0.26 millinats per word across GPT-2, OPT, and Pythia models. This metric outperforms final-layer surprisal and entropy by capturing the trajectory of word resolution across the transformer architecture.
HOW THIS AFFECTS YOU
●
researcherYou can use resolution depth to better understand how different layers contribute to semantic processing.