PerfReasoning: How Well Do LLMs Reason on Hardware Performance?

PerfReasoning benchmarks LLM ability to predict off-chip traffic and buffer requirements by reasoning over hardware architectures and workloads. While top closed-source models achieve over 90% accuracy on direct Q&A, code generation for analytical models remains difficult, with most configurations averaging below 15% pass rates. Task-specific RL improves 4B model mapping-reasoning accuracy by 15.7 points.