SITO benchmark evaluates commercial text-safety API performance
October 21, 2026
The SITO benchmark evaluates a commercial text-safety API across 2,332 synthetic cases in English, Ukrainian, and Surzhyk. Testing focused on six harm categories, revealing specific failure modes in detecting fraud, scams, and bullying in non-English contexts.
HOW THIS AFFECTS YOU
●
builderYou should account for higher false-positive or missed-harm rates when deploying these APIs in non-English markets.
●
policyYou can use these findings to assess the risks of relying on English-centric safety APIs for multilingual platforms.