ButterflyMoE Reduces Mixture of Experts Memory Scaling to Logarithmic Cost
July 9, 2026
ButterflyMoE treats Mixture of Experts (MoE) weights as geometric reorientations of a shared quantized substrate rather than independent matrices. This reduces the per-expert memory cost from O(d^2) to O(d log d), enabling much larger expert counts on memory-constrained edge devices.
HOW THIS AFFECTS YOU
●
builderYou can deploy much larger MoE models on edge hardware by using this logarithmic memory scaling approach.
●
researcherThis method changes the fundamental way experts are stored by using learned rotations of a shared ternary prototype.