Instruction Tuning Induces Number-Choice Heuristics in LLMs

Instruction tuning alters how models assign probabilities to integers, installing a round-number avoidance heuristic and sharpening endpoint avoidance. Analysis of 18 open-weight models shows that tuned checkpoints almost completely avoid multiples of 10 compared to base checkpoints.