Reference-Based Bias Detection in LLMs via Relative Representations of Hidden States

Detecting bias through hidden-state geometry allows for auditing model variants without relying on costly output benchmarks. By encoding sentences via similarities to fixed anchor points, this method measures Representational Bias Shift to track how target groups associate with attributes. The metric correlated with output-level bias changes in 15 of 18 tested settings.