Value-Guided Preference Distillation for Long-Horizon Dialogue Optimization

This method optimizes long-term dialogue outcomes by using a multi-head value model to predict dense behavioral signals across multiple horizons. It uses a multi-objective reinforcement learning approach to improve credit assignment for sparse, long-horizon rewards.