Early Detection of Reasoning Non-Convergence via Hidden-State Probes
July 24, 2026
Reasoning models like DeepSeek-R1-Distill-Qwen-7B show a bimodal convergence pattern where non-converged generations drop from 90.3% to 6.6% AIME accuracy. Linear probes on layer-20 activations at token 150 can detect this non-convergence with an AUC of 0.608.
HOW THIS AFFECTS YOU
●
builderYou can use internal activation probes to preemptively stop unproductive, long-running reasoning chains.
●
researcherHidden-state activations outperform behavioral metrics like token entropy for predicting reasoning failure.