Constrained GRPO for Self-Explaining Recommender Systems

The authors implement constrained Group Relative Policy Optimization (GRPO) to fine-tune a recommender LLM that generates faithful, non-harmful explanations. The method uses two LLM-judge reward models to ensure recommendations are grounded in user history while managing the latency and cost of frontier-model integration.