Masked Distillation for Internalizing Chain-of-Thought Reasoning
July 28, 2026
Masked distillation trains student models to produce correct answers directly by conditioning on a reasoning teacher's feedback without requiring the full intermediate CoT trace. This method aims to reduce the high latency and serving costs associated with Large Reasoning Models (LRMs).
HOW THIS AFFECTS YOU
●
builderThis approach can significantly lower inference latency and memory requirements for reasoning-heavy applications.
●
researcherThis provides a framework to compress the computational benefits of CoT into the model parameters themselves.