Using Jacobian lenses on open-weight models, this study finds that task demand increases the visibility of latent concepts in the model's representation. This suggests that attention acts as a mechanism to bring latent variables into a verbalizable form during task execution.
HOW THIS AFFECTS YOU
●
researcherYou can use these findings to better understand how task requirements influence model internal representations.