CoFiBreak Improves Red Teaming Diversity via GRPO Rewards
November 2, 2026
CoFiBreak introduces a coarse-to-fine diversity reward for Group Relative Policy Optimization to prevent attack pattern collapse during automated red teaming. This method increases the breadth of attack strategies and personas without sacrificing effectiveness or increasing inference costs.
HOW THIS AFFECTS YOU
●
researcherYou can use this reward structure to train more robust attacker models for safety evaluations.
●
policyThis helps ensure safety testing covers a wider variety of harmful intents rather than repetitive patterns.