JuryProbe Diagnostic for Reference-Free Factuality Judges

JuryProbe detects high-risk consensus among reference-free LLM judge panels by measuring false-negative-only correlations and false-consensus lift. When high risk is detected, the system routes claims to judges with access to trusted references to prevent agreement on shared falsehoods.