AgentHijack: Visual Patch Attacks on Computer-Use Agents
September 10, 2026
Visual patch attacks achieved an 84.5% T-ASR and a 20.3% end-to-end success rate in inducing malicious commands through computer-use agents. The framework demonstrates that local visual signals can bypass VLM reasoning to execute terminal commands within a GUI environment.
HOW THIS AFFECTS YOU
●
builderYou must implement visual input sanitization to protect computer-use agents from command injection via local patches.
●
policyThis reveals a critical security vulnerability in multimodal agents that requires new safety evaluation standards.