On-Policy Self-Distillation for Weight-Based Agent Memory
November 5, 2026
Researchers introduce on-policy self-distillation (OPSD) to convert episodic and semantic text-based memory into weight-based memory. This method trains a context-free student model to internalize user-specific facts, reducing the per-query costs associated with long-context retrieval.
HOW THIS AFFECTS YOU
●
builderYou can reduce inference costs and latency by moving user history from the context window into model weights.
●
researcherThe OPSD method provides a path to making weight-based memory competitive with RAG-style text retrieval.