Unsloth releases Kimi K3 GGUF quantizations including 1.5 TB MXFP4
July 28, 2026
Unsloth has released GGUF quantizations for Kimi K3, including the 1.5 TB MXFP4 version and the mmproj file. This enables local inference of the large-scale model using quantized weights.
HOW THIS AFFECTS YOU
●
builderYou can now run Kimi K3 locally using GGUF format if you have the hardware to support 1.5 TB weights.
●
researcherThis provides access to large-scale model weights for local experimentation and evaluation.