[arXiv]score: 0.25

Task-Conditioned Models Miss Safety-Critical Signals They Can Otherwise Detect

June 26, 2026

Across radiology and driving scenarios, narrowly task-conditioned language and vision models consistently suppressed reporting of co-present safety hazards they could detect when unconstrained — a pattern that persisted across model scales, appeared in reasoning models, and varied more by model family than size. This decouples benchmark safety scores from real-world safety performance.

HOW THIS AFFECTS YOU

●

builderIf you deploy task-conditioned models in safety-sensitive pipelines, your QA process likely misses this class of failure — unconstrained probing should be added to eval suites.

●

researcherThe Inattentional Gap is a reproducible, scale-invariant failure mode that invalidates narrow benchmark evaluations as proxies for real-world safety.

●

policyBenchmark-passing systems can be systematically blind to unspecified hazards, which has direct implications for AI safety certification frameworks.

●

healthRadiology models tested show this suppression effect, meaning clinical AI tools may miss incidental findings outside their specified task scope.

read original ↗arxiv.org

← back to feed