Memorilla for Efficient Latent Semantic LLM Memory
October 16, 2026
Memorilla compresses entire document collections into a fixed number of query-dependent memory tokens within the LLM's input embedding space. Using only 16 tokens, it outperforms baselines like Mem0 and MemoRAG by enabling long-context retrieval without expanding the context window.
HOW THIS AFFECTS YOU
●
builderYou can provide LLMs with massive document access while maintaining low context window overhead.
●
researcherYou can explore new methods for integrating external knowledge directly into the embedding space.