LMMR improves 2B model agent performance through multigranular memory retrieval
November 18, 2026
LMMR uses a learned retriever to select specific sentence fragments and paragraphs to fit a strict token budget. On HotpotQA, 2WikiMultihopQA, and MuSiQue, a frozen 2B model reached F1 scores of 61.47, 43.26, and 30.58 respectively using only 400 tokens.
HOW THIS AFFECTS YOU
●
builderYou can run more effective small agents by using granular retrieval to stay under strict token limits.
●
researcherThis method shows how selecting specific text segments can improve reasoning in 2B parameter models.