vLLM merges fix for CohereASR FP16 attention bias dtype
October 31, 2026
The vLLM project has integrated a fix for attention bias data type issues when running CohereASR in FP16 precision. This ensures improved numerical stability and accuracy for Cohere's automatic speech recognition models in the inference runtime.
HOW THIS AFFECTS YOU
●
builderYou can now deploy CohereASR with higher precision and fewer dtype-related errors in vLLM.