LLM Math Tutoring Benchmarks Show Massive Discrepancy in Success Metrics

Evaluating 7B-14B parameter LLM tutors via the MisconceptDialogue framework reveals that standard exact-match scoring reports a 42.1% remediation success rate, while human-calibrated LLM-as-a-judge reports 81.3%. The study highlights how measurement criteria fundamentally alter perceived performance in multi-turn educational dialogues.