CORE: Improving MLLM Embedding via Reranker Distillation
September 4, 2026
CORE improves compositional reasoning in Multimodal LLM embeddings by distilling cross-attentive reranker judgments into the embedding model. Using a Rank-KL objective and multi-level supervision, it enables better distinction between scenes with complex attribute-object bindings.
HOW THIS AFFECTS YOU
●
builderYou can improve retrieval performance in multimodal applications where object-attribute binding is critical.
●
researcherThe Rank-KL objective offers a more effective alternative to standard contrastive learning for distillation.