Encoding Probe Reconstructs Language Model Representations via Interpretable Features

An Encoding Probe reverses traditional decoding methods by reconstructing internal model representations from interpretable features like syntax and speaker identity. This approach allows for direct comparison of feature contributions and accounts for feature correlations during model interpretation.