The llama.cpp repository merged a pull request to automatically apply .scale tensors and fix correctness issues. This update improves how the inference engine handles specific tensor scaling requirements.
HOW THIS AFFECTS YOU
●
builderYou can run models more reliably with better tensor scaling support.
●
researcherYou get better mathematical correctness when running quantized models locally.