[arXiv]score: 0.11

BluTrain: Native C++/CUDA Training Framework Trains 124M GPT-2

June 24, 2026

BluTrain is a from-scratch training framework in C++ and CUDA that implements typed tensors with reverse-mode autograd, a linear algebra library, caching allocator, distributed execution, and an MLIR-based compiler — no PyTorch dependency. It validates on a 124M-parameter GPT-2 training run. Targets engineers who want hardware-level control without Python runtime overhead.

HOW THIS AFFECTS YOU

●

builderYou can use BluTrain as a reference architecture or drop-in if you need full hardware control without PyTorch's abstraction overhead, though production readiness is unproven.

●

researcherWorth watching as a systems baseline for studying training efficiency at the hardware level, with native autograd and MLIR compiler components available to instrument directly.

read original ↗arxiv.org

← back to feed