Mechanistic Signatures of Faithful Self-Reporting in Large Language Models

Training models on implicit decision tasks using low-rank adapters enables accurate self-reporting of learned preferences without explicit supervision. Research shows that as models become more introspective, preference representations migrate to earlier layers during fine-tuning.