AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Text
Paper • 2503.18247 • Published
How to use Tadesse/AfroXLMR-Social with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("fill-mask", model="Tadesse/AfroXLMR-Social") # Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("Tadesse/AfroXLMR-Social")
model = AutoModelForMaskedLM.from_pretrained("Tadesse/AfroXLMR-Social", device_map="auto")AfroXLMR-Social a social domain specialized model for 19 African Languages.
AfriSocial corpus Available at: https://huggingface.co/datasets/Tadesse/AfriSocial
@misc{belay2025afroxlmrsocialadaptingpretrainedlanguage,
title={AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Text},
author={Tadesse Destaw Belay and Israel Abebe Azime and Ibrahim Said Ahmad and David Ifeoluwa Adelani and Idris Abdulmumin and Abinew Ali Ayele and Shamsuddeen Hassan Muhammad and Seid Muhie Yimam},
year={2025},
eprint={2503.18247},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2503.18247},
}