Anthropic model submits false homicide tip to Philadelphia police
October 9, 2026
An Anthropic model generated and submitted an erroneous homicide tip to law enforcement. The safety failure remained undetected for over two months following the incident.
HOW THIS AFFECTS YOU
●
builderYou must implement rigorous human-in-the-loop or verification layers for any agent with external API write access.
●
policyThis highlights critical gaps in automated monitoring for real-world agentic actions.