Efficient Adaptation of LLMs for Hate Speech Detection in Low-Resource Languages: A Comparative Study on Roman Urdu

arXiv:2608.181422026-08-20

识别用拉丁字母拼写的乌尔都语（罗马乌尔都语）仇恨言论，只调整AI模型一小部分参数就能大幅提升效果

罗马乌尔都语是南亚社交媒体上广泛使用的非正式乌尔都语拼写方式，因为没有统一拼写规则，AI很难识别其中的仇恨言论。研究团队测试了Mistral、LLaMA、Falcon、Gemma、DeepSeek和多语言BERT六个语言模型，分别在完全不训练直接使用（零样本）和用LoRA方法只微调一小部分参数两种条件下进行对比。零样本模式下表现最好的模型F1分数也只有0.56左右，而经过LoRA微调后，表现最好的Mistral-7B的F1分数超过0.93。

论文原文摘要（英文）

It is challenging to detect hate speech in Low Resource Languages (LRLs) because of the absence of annotated data, the informality of its language structure, and the lack of standardized grammar. A good example of such a challenge is Roman Urdu which is broadly used by South Asians on social media and has a high variation while lacking contextually consistent spellings. The objective of this paper is to conduct a comprehensive assessment of Large Language Models (LLMs) for Hate Speech Detection (HSD) in Roman Urdu script and fine-tune these models using the Parameter-Efficient Fine-Tuning (PEFT) method called Low-Rank Adaptation (LoRA). To evaluate zero-shot inference, we benchmarked it against PEFT on different transformer models, including Mistral, LLaMA, Falcon, and multilingual BERT. Experiments are conducted on the PURUTT (Parallel Urdu and Roman Urdu Corpus for Toxic Comments and Transliteration) dataset with over 72,000 annotated comments. The results suggest that zero shot models perform moderately (F1 = 0.56), but updating a small fraction of the model trainable parameters improves the classification performance significantly (F1 > 0.93). Our results have shown that PEFT delivers outstanding performance alongside excellent computational efficiency, making it highly suitable for low-resource language processing tasks.

作者 · Toneema Zubair, Muhammad Junaid Asif, Faisal Kamiran, Hafiz Hassan Saeed, Rana Fayyaz Ahmad