High Consistency Does Not Guarantee Accuracy in Label-Free Evaluation

Testing four financial QA datasets shows that 60% of incorrect answers fall into high-consistency regions (consistency >= 0.8). Furthermore, 77.7% of these incorrect answers exhibit complete answer collapse, where the model provides identical wrong answers across all perturbations.