Qwen 3.8 FN inference benchmark comparison on RTX 5090
October 23, 2026
Benchmarking of Strata, Infernix, capy-flash, ninfer, llama.cpp, and Basalt engines on an RTX 5090 shows varying performance using NVFP4 quantization. The tests evaluated decode speeds across short and long context windows under a 400W power profile.
HOW THIS AFFECTS YOU
●
builderYou can use these throughput numbers to select the most efficient inference engine for your Qwen 3.8 deployments.
●
researcherThe data provides empirical evidence of NVFP4 quantization performance across different implementation architectures.