DFlash2 Optimization Reaches 138 TPS for Qwen3.8-27B on RTX 3090
August 19, 2026
A new inference optimization using DFlash2 drafting achieves 138 tokens per second on a single RTX 3090 for Qwen3.8-27B. The stack utilizes FP8 KV cache, int8 embeddings, and MTP-4 drafts to reduce follow-up turn latency from 23 seconds to approximately 1 second.
HOW THIS AFFECTS YOU
●
builderYou can significantly reduce KV cache memory and latency on consumer hardware by combining FP8 caching with specialized drafting heads.