Two-Thirds of LLM Zero-Shot Annotation Errors Resist Prompt Correction

Experiments on toxicity detection across social media, gaming, news, and forum datasets show that roughly two-thirds of zero-shot LLM errors are resistant to correction via additional prompt context, a phenomenon the authors call decision stickiness. Both dense and mixture-of-experts models show susceptibility to misaligned task definitions.