Layer-wise Representation Dynamics: An Empirical Investigation Across Embedders and Base LLMs

Proposes Layer-wise Representation Dynamics (LRD) framework with three measurement families—Frenet geometry, Neighborhood Retention Score, and Graph Filtration Mutual Information—to analyze hidden state changes across 31 encoder and decoder-based language models.