Instruction-Tuned Models Pre-Commit Answers Before Generating Chain of Thought

Linear probes on residual stream activations at the final token before CoT generation can predict model answers with >0.9 AUC. Research shows these directions are causal, meaning steering activations can flip model decisions independently of the verbalized reasoning.