Cache-to-Cache enables direct semantic communication between LLMs via KV-Cache

Cache-to-Cache bypasses token-by-token text generation by transmitting enriched KV-Cache semantics directly between models. This method preserves rich semantic information and reduces latency by avoiding the lossy transformation of internal representations into text sequences.