Measuring Self-Referential Loops in Entity-Level Machine Translation
August 13, 2026
Analysis of entity-level translation shows that using a knowledge base (KB) as both the source of truth and the evaluation metric creates a self-referential loop. In tested historical datasets, only 31.1% of expert-annotated person names remained independent of the injection pipeline, measuring instruction compliance rather than translation quality.
HOW THIS AFFECTS YOU
●
researcherYou should account for injection-pipeline bias when using KBs to evaluate RAG or translation systems.
●
policyThis highlights risks in automated fact-checking where the system's own knowledge base validates its errors.