BARC-Bench Evaluates Safety Risks in Underspecified Agent Instructions

BARC-Bench introduces 110 tasks across nine workspace environments to test if agents follow benign requests while inadvertently violating safety boundaries. Evaluation of frontier models shows safety success rates as low as 9.1%, with even top-tier configurations failing 27.3% of tasks by violating implicit social or environmental norms.