A recent merge in llama.cpp resolves an invalid vector subscript error that occurred when loading models on a GPU with full memory. This improves stability for local inference on memory-constrained hardware.
HOW THIS AFFECTS YOU
●
builderYou can rely on more stable local inference when running near the limits of your GPU VRAM.