SSD-Based MoE Inference via TokenWing and Run My AI
November 18, 2026
TokenWing enables SSD-offloading of over 60% of MoE experts, allowing a 120B model to run on 12GB VRAM at 45-50 tok/s. The companion Run My AI GUI provides a local interface for these high-speed, low-VRAM inference capabilities.
HOW THIS AFFECTS YOU
●
builderYou can run massive 120B parameter models on consumer laptops by offloading experts to an SSD.
●
founderThis opens up new opportunities for shipping high-performance local AI applications on low-spec hardware.