CoMem Achieves 97.05 RULER Score via Layer-Wise Context Caching
July 31, 2026
CoMem leverages a depth division of labor by caching residual states at intermediate layers to enable unbounded-context memory. Using a rank-32 LoRA on Qwen3-8B, the method achieves 97.05 on RULER and 38.27 on LoCoMo, maintaining constant read compute and memory relative to context length.
HOW THIS AFFECTS YOU
●
builderYou can implement unbounded memory systems where inference costs do not scale linearly with context length.
●
researcherYou can exploit layer-specific specialization to optimize long-context retrieval.