Unified Information-Economic Framework Links KV Cache to Marginal Utility

This theoretical framework equates transformer KV cache eviction and low-rank compression to constrained utility maximization. It proposes an allocation rule where dimensions are retained if their eigenvalue exceeds the shadow price of the memory constraint.