monsoon-nlp/sanaa-dialect

This is a small GPT-2 model, originally trained on Arabic Wikipedia circa September 2020 . Finetuned on dialect datasets from Qatar University, University of British Columbia / NLP, and Johns Hopkins University / LREC . You can use special tokens to prompt five dialects: [EGYPTIAN], [GULF], [LEVANTINE], [MAGHREBI], and [MSA] There is NO content filtering in the current version; do not use for public-facing text generation! The current version of this version of the model is not available to the public-serving users of this model . The model and training details are published at http://hugging,