AdaCodec Cuts Redundant Visual Tokens in Video MLLMs Using Predictive Frame Coding

AdaCodec reduces visual token count in video MLLMs by sending full-resolution tokens only for reference frames with high conditional predictive cost, encoding subsequent frames as compact inter-frame change descriptors including motion and residuals. This mirrors video codec logic at the token level, directly addressing the redundancy problem in per-frame RGB encoding.