Probing LLM Internal Activations to Extract HMM Algorithms

Researchers developed the Principal Activations Probe (PAP) to investigate how LLMs implement Hidden Markov Models via in-context learning. The study uses layer-wise probing and intervention to isolate the underlying algorithmic mechanisms within Transformer architectures.