Weight-space programming improves Qwen3.5-0.8B math accuracy from 7.9% to 48.1%
November 11, 2026
Astra can perform weight-space programming by editing model weights directly without gradients or training loops. By changing just 0.016% of the weights in Qwen3.5-0.8B, the model's MATH-500 accuracy increased from 7.9% to 48.1%.
HOW THIS AFFECTS YOU
●
builderYou can boost specific model capabilities by editing a tiny fraction of existing weights.
●
researcherYou can improve small models by reasoning about weight computations rather than using standard training.