MCPO Compresses Multimodal Chain-of-Thought via Modality-Contrastive Optimization
September 7, 2026
MCPO uses a step-level Normalized Cross-Modal Mutual Information (NCMI) pruning algorithm to remove visual-independent reasoning steps. This two-stage method requires fewer than 900 samples to reduce KV-cache pressure and computational costs in multimodal models.
HOW THIS AFFECTS YOU
●
builderYou can reduce inference latency and KV-cache overhead in multimodal reasoning models using this compression technique.
●
researcherThis method utilizes cross-modal mutual information to guide sample-efficient CoT pruning.