LLMs Reproduce Cross-Jurisdiction State Policy Substitutions
October 8, 2026
Testing on 51 U.S. jurisdictions shows Claude Sonnet 5.5 and GPT-5.6 Sol reproducibly substitute state-specific policy values with values from other states. These errors are not random hallucinations but specific cross-state data transfers that are difficult to attribute via standard record checking.
HOW THIS AFFECTS YOU
●
builderYou must implement strict verification for RAG pipelines handling jurisdiction-specific legal or policy data.
●
policyThis highlights a specific, reproducible failure mode in LLMs regarding regional regulatory compliance.