[HN]score: 0.27Gemma 4 26B MoE runs at 5 tokens/sec on 2013 Xeon hardwareJuly 15, 2026The Gemma 4 26B-A4B mixture-of-experts model achieves 5.2 tokens/sec decode and 16 tokens/sec prompt evaluation on dual Intel Xeon E5-2690 v2 processors. This setup uses Q8_0 quantization on legacy hardware lacking AVX2, FMA3, or dedicated GPU acceleration.HOW THIS AFFECTS YOU●builderYou can explore running MoE models on legacy CPU-only infrastructure if you optimize for specific quantization levels.read original ↗neomindlabs.comDAILY DIGEST_all newsbuilderresearcherfounderinvestordesignerpolicyhealthsubscribe →you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy← back to feed