AgentRouter Reduces Agentic Workflow Costs by 72% via Step-Level Routing

AgentRouter uses a 12M parameter classifier to assign individual agent trajectory steps to different model tiers, achieving a 72% cost reduction compared to using frontier models for every task. The router adds less than 5ms overhead per step on an A100 and handles subtasks like planning, coding, and data analysis.