Qwen 3.8 27B autonomously develops CUDA inference kernels
September 20, 2026
A local agent loop running on a single RTX 3090 spent 21 days attempting to write a custom CUDA inference engine. While it achieved prefill speeds of approximately 250 TPS, the resulting kernels did not outperform llama.cpp.
HOW THIS AFFECTS YOU
●
builderAutonomous kernel optimization shows potential for specialized hardware acceleration via agentic loops.
●
researcherLong-running unsupervised agentic loops for low-level systems programming present new stability and convergence challenges.