Janas Enables LLM Execution Larger Than RAM via SSD Expert Streaming
October 12, 2026
Janas streams experts from an NVMe SSD to run models exceeding system memory. In benchmarks, it achieved 37 tok/s on a 48 GB Qwen3-Next-80B model using only 32 GB of RAM, significantly outperforming llama.cpp on the same hardware.
HOW THIS AFFECTS YOU
●
builderYou can run large-scale models on consumer hardware with limited RAM by leveraging fast NVMe storage.