LoRA Fine-Tuning for Roman Urdu Hate Speech Detection
August 20, 2026
This study evaluates LLMs for hate speech detection in Roman Urdu, a low-resource language with high spelling variation. Researchers compared zero-shot inference against LoRA fine-tuning on Mistral, LLaMA, Falcon, and multilingual BERT using the 72,000-sample PURUTT dataset.
HOW THIS AFFECTS YOU
●
builderYou can implement LoRA to improve moderation accuracy in South Asian social media contexts.
●
researcherYou can leverage these findings to optimize PEFT methods for low-resource, non-standardized text.