SHADOW-50M Achieves 1,900 tok/s on CPU with 44M Parameters
September 15, 2026
SHADOW-50M is a 44M parameter model trained on 45B tokens using ternary {-1, 0, +1} weights. It achieves 1,900 tok/s on laptop CPUs and uses 512-bit fingerprints for a 73,880-token vocabulary, enabling high-speed offline inference and WebAssembly execution.
HOW THIS AFFECTS YOU
●
builderYou can deploy extremely lightweight, high-throughput models for edge devices or browser-based environments.
●
researcherThis demonstrates the potential of ternary weights and fingerprint-based vocabularies for extreme efficiency.