AdaMem optimizes RAG by dynamically allocating a fixed budget of memory embeddings based on passage-relevance scores. A single-pass, query-conditioned compressor produces both continuous memories and relevance estimates, outperforming static allocation methods across six open-domain QA benchmarks.
HOW THIS AFFECTS YOU
●
builderYou can reduce inference costs and noise in RAG systems by focusing token budget on high-relevance passages.
●
researcherYou can utilize query-dependent soft compression to improve efficiency in long-context retrieval tasks.