Attention Mechanism Facilitates Latent Variable Verbalization in LLMs

Testing on open-weight models using Jacobian lenses reveals that task demand increases the visibility of latent concepts in the word workspace. While no specific gate mechanism was found, the research shows that a single linear map can decode variables from multiple task arms, outperforming selection-corrected floors by 6.4-9.0x.