Parameter-trajectory crosscoding tracks LLM capability acquisition

New research shows LLM hidden states encode task information well before the readout matrix expresses it. By applying parameter-trajectory crosscoding to checkpoint weights, the authors identify a narrow window during Pythia pretraining where task-specific information first emerges.