SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessment

SAFARI introduces an industrial benchmark of 3,000 de-identified automotive HARA cases to evaluate LLM performance under ISO 26262 standards. Evaluations of nine frontier models show high-quality hazard narratives but poor risk classification, with the top ASIL macro-F1 score reaching only 0.261. Chain-of-Thought prompting offers limited gains and can degrade categorical accuracy.