Cloudflare Workers AI optimizes Kimi and GLM inference using SGLang

Cloudflare scales Kimi and GLM Mixture-of-Experts models by implementing KV cache quantization, weight compression, and cache protection. Using SGLang for inference, these optimizations allow for higher request density on shared GPUs without sacrificing model accuracy.