GateSight Predicts KV Cache Utility for Efficient Hybrid LLMs

GateSight uses recurrent memory in hybrid models to anticipate the future utility of KV entries in attention layers. By learning to predict which entries are critical through lightweight per-head multilayer perceptrons, it enables more efficient query-agnostic KV eviction.