SpikeOPD Mitigates Prefix-Source Mismatch in SNN Language Model Distillation
August 31, 2026
On-policy distillation (OPD) addresses output-policy mismatch and internal spiking-dynamics drift during ANN-to-SNN migration. By continuing teacher supervision on self-generated prefixes rather than fixed corpus prefixes, the method stabilizes the training of autoregressive spiking language models.
HOW THIS AFFECTS YOU
●
researcherYou can use on-policy supervision to bridge the gap between static ANN teachers and dynamic SNN student inference.