Accès ouvert · CC BY

ArGAN: Arabic Gender, Ability, and Nationality Dataset for Evaluating Biases in Large Language Models

Article scientifique 2025 Sciences sociales et comportementales › Sociologie (OCDE 5.4) Anglais

Résumé

Large language models (LLMs) are pretrained on substantial, unfiltered corpora, assembled from a variety of sources.This risks inheriting the deep-rooted biases that exist within them, both implicit and explicit.This is even more apparent in low-resource languages, where corpora may be prioritized by quantity over quality, potentially leading to more unchecked biases, particularly in low-resource languages, where all available data is leveraged solely to expand volume due to inherent scarcity.More specifically, we address the biases present in the Arabic language in both general-purpose and Arabic-specialized architectures in three dimensions of demographics: gender, ability, and nationality.We introduce ArGAN, a dataset for evaluating the fairness of these models across three demographic axes: gender, ability and nationality.Where we experiment with bias-revealing, template-based prompts and measure performance and bias using existing and evaluation metrics, and propose adaptations to others.

Citer ce document

Aly, R., Allam, Y., Gaber, R., & Basta, C. (2025). ArGAN: Arabic Gender, Ability, and Nationality Dataset for Evaluating Biases in Large Language Models. https://doi.org/10.18653/v1/2025.gebnlp-1.23

Exporter : BibTeX · RIS (Zotero, Mendeley, EndNote)

Accès au document

Texte intégral archivé sur SPHAERO, en accès ouvert : lisible gratuitement en ligne après connexion. Le document reste aussi disponible à sa source. Se connecter

Voir l'article sur le site de la revue

Licence et provenance

Licence : CC BY

Notice moissonnée depuis OpenAlex le 28/09/2026. Le document reste hébergé par sa source.
Voir le document à la source →

Statistiques

Consultations (hors robots) : 11

Téléchargements (hors robots) : 0

Méthode de comptage