Residual Vector Reconstruction Enables Long-Context Recall with Constant GPU Memory

This method reconstructs facts using parameter activations in LLM feed-forward layers to maintain near-constant GPU memory usage regardless of context length. It allows for deterministic fact retrieval from source documents without referencing the original tokens or requiring additional fine-tuning.