TrustMod-SM benchmark reveals reliability gaps in social media moderation
November 11, 2026
The TrustMod-SM benchmark evaluates 16 open-weight models and one closed model across 29,000 instances in social media moderation. Results show that scaling models does not fix demographic disparity, and models under 8B parameters specifically struggle to distinguish hate speech from reclaimed language.
HOW THIS AFFECTS YOU
●
builderYou should be cautious when using models under 8B parameters for complex moderation tasks like distinguishing hate speech.
●
researcherYou can use this 29,000-instance benchmark to test for fairness and robustness in moderation models.
●
policyThis shows that larger models do not automatically solve demographic bias in automated moderation.