Predictive Accuracy in Knowledge Tracing Does Not Guarantee Parameter Recovery
October 23, 2026
Knowledge tracing models can achieve high next-response prediction accuracy while failing to correctly recover underlying item parameters. Simulations show that while difficulty and threshold recovery remains stable, discrimination and option slope estimates depend heavily on representation width and item order.
HOW THIS AFFECTS YOU
●
researcherDo not assume a high-performing predictive model has accurately captured the latent parameters of the items being evaluated.