Plausible but Not Valid: A Psychometric Audit of LLMs as Synthetic Survey Respondents

LLMs often fail to preserve the latent structure and joint distributions of human survey data, even when individual responses appear plausible. Evaluation using a 68-item organizational psychology dataset across 37 models shows that persona disclosure and reasoning effort do not fully mitigate discrepancies in reliability and demographic effects.