lighteternal/gpt2-finetuned-greek

A text generation (autoregressive) model, using Huggingface transformers and fastai based on the English GPT-2.Finetuned with gradual layer unfreezing . This is a more efficient and sustainable alternative compared to training from scratch, especially for low-resource languages . We used a 23.4GB sample from a consolidated Greek corpus from CC100, Wikimatrix, Tatoeba, Books, SETIMES and GlobalVoices containing long senquences . The model was created by the Hellenic Army Academy (SSE) and the Technical University of Crete . It is a better version of our small model (https://huggingface,