Value-Rectified Distillation for Mitigating OOD Mode Averaging in Offline RL
October 22, 2026
Value-Rectified Distillation (VRD) addresses OOD mode averaging in Flow Matching-based offline reinforcement learning. It employs a dynamic coupling mechanism to decouple distinct behavioral modes, using value-quantile distillation to prevent policy collapse into invalid action regions.
HOW THIS AFFECTS YOU
●
researcherThis provides a method to prevent multi-modal datasets from causing policy interpolation into low-value states.