Lngram v2 Decouples Memory Capacity from Backbone Width
September 4, 2026
Lngram v2 introduces a latent n-gram memory mechanism that scales memory independently of backbone width using context-aware grouped-query attention. The method scales successfully to 30B-parameter vision-language models while reducing activation costs.
HOW THIS AFFECTS YOU
●
researcherYou can scale the memory capacity of VLMs without linearly increasing parameter or activation overhead.