SHAM-Bench is a new unified benchmark comprising 6,461 examples across six NLG tasks to detect span-level hallucinations. It reveals that while fine-tuned detectors excel in-domain, they struggle with distribution shifts compared to reasoning-based prompt methods.
HOW THIS AFFECTS YOU
●
researcherYou can use this to test the cross-domain generalization of hallucination detection methods.