Accès ouvert · CC BY

Somali dialect identification in low-resource settings using machine learning and deep learning

Résumé

Abstract This study investigates automatic dialect identification for the Somali language, focusing on its two primary dialects: MAXAA TIRI and MAAY. Somali exhibits substantial dialectal variation, which poses challenges for natural language processing (NLP) applications in low-resource settings. To support dialect-aware NLP research, we construct and manually annotate a dataset of 8947 Somali text samples collected from heterogeneous sources, including social media, news outlets, blogs, and formal documents. The study evaluates a range of traditional machine learning and deep learning models, including Naive Bayes, Support Vector Machines (SVM), and Bidirectional Long Short-Term Memory (BiLSTM) networks, for dialect classification. Experimental results show that Naive Bayes and BiLSTM achieve high classification performance under controlled evaluation settings. To mitigate overfitting and source bias, we apply source-aware data splitting, duplicate removal, and ablation analyses. However, results should be interpreted in light of dataset construction constraints, including expert-assisted translation for portions of the MAAY data. This work contributes a linguistically validated Somali dialect dataset and provides empirical insights into the effectiveness of machine learning and deep learning approaches for dialect identification in low-resource contexts.

Citer ce document

Gedi, A. A., Ahmed, Y. M., Mohamed, S. A., Yusuf, Y. A., & Ebdiyow, A. U. (2026). Somali dialect identification in low-resource settings using machine learning and deep learning. Discover Data. https://doi.org/10.1007/s44248-026-00109-y

Exporter : BibTeX · RIS (Zotero, Mendeley, EndNote)

Accès au document

Texte intégral archivé sur SPHAERO, en accès ouvert : lisible gratuitement en ligne après connexion. Le document reste aussi disponible à sa source. Se connecter

Voir l'article sur le site de la revue

Licence et provenance

Licence : CC BY

Notice moissonnée depuis OpenAlex le 01/10/2026. Le document reste hébergé par sa source.
Voir le document à la source →

Statistiques

Consultations (hors robots) : 28

Téléchargements (hors robots) : 0

Méthode de comptage