Instruction Tuning Increases LLM Overconfidence and Reduces Diversity

Instruction tuning improves task performance but leads to increased verbalized overconfidence and decreased lexical diversity in rationales. This effect occurs even when predictive accuracy remains stable, impacting how models are calibrated for uncertainty.