Frontier Coding Agents Reach Only 10% of GPU Roofline on Production Traces

Atrex-Bench, a new benchmark using 440 shapes sampled from real-world production inference traces, reveals that even top coding agents achieve only 10% of the hardware roofline. The study finds that current agent performance is often inflated by PyTorch fallbacks rather than high-performance kernel generation.