Interpreting Code Variable Roles via Sparse Autoencoders

This study uses a taxonomy of eleven variable roles, such as accumulation and traversal, to evaluate LLM understanding across five languages. Findings show that residual probes on model activations outperform individual SAE features in recovering these functional distinctions.