PTXBench Evaluates LLMs for GPU Kernel Optimization
August 19, 2026
PTXBench evaluates LLM ability to generate architecture-specific PTX for H100 and B200 GPUs across GEMM and attention workloads. SFT on Qwen3.6-27B improves performance, but models still struggle with complex attention backward workloads and often fail to match frontier libraries.
HOW THIS AFFECTS YOU
●
builderUse this benchmark to evaluate if your models can effectively automate low-level CUDA/PTX optimizations.
●
researcherThe findings suggest significant headroom in training models for hardware-specific reasoning and repair-conditioned tasks.