TRAG Improves Zero-Shot Robustness in Vision-Language Models
November 11, 2026
Textual Response-Aware Guidance (TRAG) improves the adversarial robustness of VLMs by constraining visual representation drift using the text encoder's responses to local embedding variations. This method aims to preserve pre-trained image-text relationships during fine-tuning.
HOW THIS AFFECTS YOU
●
researcherYou can use text encoder responses to guide visual representations during adversarial fine-tuning.
●
policyYou can deploy more robust vision-language models that are less vulnerable to adversarial image attacks.