Label-Free Reliability Estimation for LLM Ensembles via EM
October 16, 2026
This method estimates the reliability of language model experts using Expectation Maximization on unlabelled agreement patterns. On a 1560-question benchmark using nine models up to 3B parameters, it achieves performance comparable to label-based fusion rules.
HOW THIS AFFECTS YOU
●
builderYou can implement more reliable LLM ensembles without needing ground-truth labels for training.
●
researcherThis provides a way to model expert credibility through latent agreement patterns rather than fixed reputations.