GroNLP/gpt2-small-italian-embeddings

This model is based on the small OpenAI GPT-2 (gpt2) model . Transformer layer weights in this model are identical to the original English, model but the lexical layer has been retrained for an Italian vocabulary . For details, check out our paper on arXiv and the code on Github . For more information, please visit our paper and Github page: Gpt2-2 recycled for Italian (small, adapted lexical embeddings) [Gpt-2 recycle for Italian, adapted for Italian vocabulary] Gpt2 is a small model size with retrained lexical embeddeddings and additional fine-tuning of the full model. (,