ReCache Efficient KV Cache Reuse for Tool-Augmented Agents

ReCache optimizes tool-augmented LLM agents by using resource-wise attention to create composition-invariant KV blocks. This framework achieves a 3.655x speedup in inference time while maintaining 82.3% Inv-F1 performance by selectively pruning and caching tool schemas.