Aha-Flow Distillation improves reasoning via dual-mode supervision
September 9, 2026
Aha-Flow Distillation (AFD) uses on-policy self-distillation to pair concise solution-based supervision with Flow-CoT, which utilizes linguistic flow markers. This dual-mode approach leverages both 'Aha Moments' for revision and 'Flow Moments' for sustained reasoning during training.
HOW THIS AFFECTS YOU
●
builderYou can improve reasoning model performance by incorporating specific reasoning-trace styles into your fine-tuning data.
●
researcherYou can explore linguistic discourse markers as auxiliary supervision for distillation tasks.