Parsimony benchmark measures AI code verbosity using coding units
October 13, 2026
Parsimony evaluates how much excess code AI models generate by analyzing patches from SWE-bench datasets. Instead of line counts, it uses coding units—syntax elements like statements, calls, and literals—to penalize models that increase codebase complexity.
HOW THIS AFFECTS YOU
●
builderYou can use this to select models that minimize technical debt rather than just maximizing solve rates.
●
researcherThis introduces a more granular metric for evaluating the efficiency and maintainability of AI-generated software patches.