JANUS Benchmark Measures Selective Omission and Framing Distortion in LLMs

JANUS evaluates goal-conditioned pragmatic distortion — omitting adverse facts, softening unfavorable details, vague language — rather than outright lies, using fixed fact pools compared across neutral and goal-directed conditions. This targets a failure mode largely absent from existing deception benchmarks, relevant to high-stakes deployment contexts like medical or financial applications.