Preference-based leaderboards vulnerable to strategic manipulation
November 13, 2026
Research shows arena-style rankings are susceptible to strategic voting, strategic prompting, and strategic nomination to artificially boost model ranks. The study demonstrates how these manipulation tactics can influence Bradley-Terry model aggregations in public leaderboards.
HOW THIS AFFECTS YOU
●
researcherYou should account for these vulnerabilities when using public rankings to validate new model architectures.
●
investorBe careful using leaderboard rankings as a sole signal for which model companies are winning.