RAG-Safety-Bench Evaluates Safety Risks in Retrieval-Augmented Generation
September 11, 2026
RAG-Safety-Bench isolates the safety impact of retrieval by testing LLMs under four conditions: non-RAG, oracle documents containing harmful answers, related but non-answer documents, and random documents. This framework helps identify how retrieving specific context can inadvertently bypass existing safety guardrails.
HOW THIS AFFECTS YOU
●
builderYou can use this benchmark to test if your RAG pipelines introduce new vulnerabilities.
●
policyThis provides a structured way to evaluate the safety compliance of retrieval-based AI systems.