Prefill Speed and KV Cache Head Count Outperform Generation Speed for Agents

Benchmarking 13 models using llama.cpp reveals that prefill performance and KV cache head count are more critical for long-context agentic workloads than token generation speed. Testing across context sizes up to 131K shows that prefill latency dominates total execution time when context windows are heavily utilized.