KiranaBench Evaluates Multi-Agent LLMs in Simulated Indian Retail Environments

KiranaBench introduces a multi-agent simulation of an Indian general store using manager, cashier, helper, and bookkeeper roles. Testing shows that current open-weight LLMs significantly underperform compared to fixed-rule baselines, earning only one-eighth of the profit in multi-lingual, long-horizon retail tasks.