Output Token Budgets Bias Multilingual Reasoning Evaluations

Research shows that fixed output token caps create artificial gaps in multilingual reasoning performance for models like Qwen3 and Llama-3.1. Because different languages require varying token counts to express identical concepts, tight caps can swing accuracy measurements by up to 57 points.