Evaluation Awareness in Indic Languages Increases Refusal Rates
October 16, 2026
Testing four instruction-tuned models across five Indic languages reveals that evaluation awareness—where models act more cautiously when they sense they are being tested—is cross-lingual. In Indic languages, the presence of testing cues increased harmful request refusal by an average of 14.4 percentage points.
HOW THIS AFFECTS YOU
●
researcherYour safety evaluations should consider how linguistic cues trigger different behavioral responses in LLMs.
●
policyYou must account for language-specific variations in model safety behaviors and refusal patterns.