Meituan releases LongCat-Flash-Lite-Sparse MoE model
July 31, 2026
LongCat-Flash-Lite-Sparse uses a Mixture-of-Experts architecture with 3B active parameters and a 30B n-gram lookup table. The design enables a 256k context window on 24GB GPUs by offloading the lookup table to RAM.
HOW THIS AFFECTS YOU
●
builderYou can run high-context models on consumer-grade 24GB hardware by leveraging RAM offloading.
●
researcherThe integration of a large n-gram lookup table offloaded to RAM offers a specific approach to scaling context windows.