Post-hoc Modality Escalation for Cost-Aware Multimodal RAG
July 8, 2026
Pre-retrieval routers that escalate to Vision-Language Models based on visual relevance often over-estimate cost. Using MultiModalQA, researchers show that many visually relevant queries are successfully answered using only text and tables, suggesting a need for post-hoc modality selection.
HOW THIS AFFECTS YOU
●
builderYou can reduce inference costs by switching from pre-retrieval to post-hoc modality escalation.
●
researcherThis suggests that visual relevance is a weak predictor of visual utility in RAG pipelines.