Aurora-80K: Extremely Small 80k Parameter Language Model
August 20, 2026
Aurora-80K is a tiny language model featuring an 80,000 parameter count and a 4,096-token vocabulary. Benchmarks include 3.2902 Wikitext-2 BPB and 52.31% on BLiMP.
HOW THIS AFFECTS YOU
●
builderYou can deploy this for highly constrained edge environments where memory is at an absolute premium.
●
researcherThis provides a minimal baseline for studying extreme parameter-to-vocabulary ratios.