●builderYou should view context window expansion as a resource allocation problem between active computation and inactive storage.
●researcherYou can use this taxonomy to better understand the interplay between KV-cache offloading and retrieval-augmented generation.