Hidden States Provide Marginal Improvements for Hallucination Detection

Integrating model hidden states into hallucination detection improves AUROC by only 0.004 for open-ended generation and 0.039 for multiple-choice tasks. The results suggest that internal states offer limited incremental predictive value over strong output-side baselines.