ISTA-DASLab released GGUF quantizations for DeepSeek-V4.1-Flash-1017 using the GSQ-RCO smart quantization approach. Current support is limited to specific forks like Xolotl or Maya as main llama.cpp architecture support is pending.
HOW THIS AFFECTS YOU
●
builderYou can run these optimized DeepSeek quants now, provided you use compatible inference engines.