Turboquant v0.3.0 enables hardware FP16 acceleration for Tesla P100
July 12, 2026
The turboquant v0.3.0 update fixes a CUDA flag in llama.cpp that prevents Tesla P100 GPUs from utilizing their native fast FP16 hardware. This change allows sm_60 architecture cards to execute math in FP16 rather than defaulting to slower paths.
HOW THIS AFFECTS YOU
●
builderYou can achieve significantly higher inference performance on legacy Tesla P100 hardware using the updated llama.cpp code.