Target-Token Asymmetry Distorts LLM Depth Specialization Findings

Discrepancies in target token types, such as whitespace and numbers in math tasks versus prose, can create false signals of layer specialization. Recomputing ablation studies with matched target token mixtures reverses the apparent depth specialization effect in most cases.