EliteReplay: Preserving Solution Diversity via Quality-Diversity Search

EliteReplay prevents the behavior-sharpening effect of RL post-training by pairing GRPO with an archive of diverse solutions generated through quality-diversity search. On text-to-SQL tasks, the method improves accuracy while maintaining a higher pass@128 compared to standard post-training methods.