FreeToken is an edge-native serving system for Mixture-of-Experts (MoE) models designed for heterogeneous personal hardware. It uses a bandwidth-adaptive execution strategy that continuously maps model state and computation to available CPU and GPU resources.
HOW THIS AFFECTS YOU
●
builderYou can deploy large MoE models on local hardware with better resource utilization through adaptive offloading.