Multiplication Error Patterns Identified in Small Qwen LLMs
October 30, 2026
An investigation into LLM arithmetic reveals that multiplication errors in small Qwen models do not follow the noisy quantization patterns seen in addition. Instead, errors in lower-order columns preserve parity, while higher-order errors shift toward off-by-one carry failures.
HOW THIS AFFECTS YOU
●
builderBe aware of specific parity and carry-based error profiles when using small models for mathematical tasks.
●
researcherThis identifies distinct, multi-periodic internal representations for different arithmetic operations in LLMs.