New Optimizer Reduces Training VRAM to 1 Byte Per Weight
November 11, 2026
A new optimizer for ternary networks reduces VRAM requirements from 16 bytes per weight to 1 byte or less. This allows training a 27B parameter model on a single 24GB RTX 3090.
HOW THIS AFFECTS YOU
●
builderYou can train 10-20B parameter models on consumer gaming GPUs.
●
researcherThis method achieves ternary training without the memory overhead of maintaining full-precision weights.