OnPoKD: On-Policy Distillation for Vision-Language Model Adaptation

The OnPoKD framework uses a lightweight controller to learn sample-wise adaptive distillation targets based on teacher-student disagreement cues. This approach addresses unreliable distillation caused by class and domain shifts in low-quality multimodal datasets.