Standard NLP debiasing techniques, such as swapping group references or removing stereotypical sentences, can trigger unintended counter-stereotyping in unrelated demographics. Analysis across encoder and decoder models shows these side effects often bypass standard benchmarks and show no significant changes in attention flow.
HOW THIS AFFECTS YOU
●
researcherYou should test for side effects in unrelated demographics when applying preprocessing-based debiasing.
●
policyCurrent benchmarks are insufficient for evaluating the true safety and neutrality of debiased models.