DPO and SFT outperform GRPO in mitigating knowledge-prompt conflicts

Post-training methods vary in their ability to ground models in provided context when it contradicts memorized knowledge. DPO drives grounding near its theoretical ceiling on matched distributions, while GRPO variants show minimal gains in grounding despite improved reward metrics. Both Conflict-SFT and DPO primarily utilize the same causal attention heads present in the base model.