Risk-Constrained Freshness-Aware Semantic Caching for Open-Web Retrieval-Augmented LLMs

FreshCache introduces a three-tier semantic cache that models information decay using an exponential decay function and a learned MLP to mitigate staleness in RAG systems. The framework approves cache hits only when the estimated error probability stays within specific budgets for answers (0.10), URLs (0.20), and page content (0.35).