BudgetSchemaBench: A Budget-Swept Diagnostic for Schema Context in Text-to-SQL
October 2, 2026
BudgetSchemaBench evaluates the trade-off between schema coverage and serialization detail in text-to-SQL tasks using an 80-database catalog. The diagnostic uses mechanical relevance labels derived from gold SQL to measure performance across varying context budgets. It tests end-to-end retrieval and table-omission scenarios to identify optimal schema representation strategies.