huseinzol05/gpt2-117M-bahasa-cased

Pretrained GPT2 117M model for Malay was pretrained on 0.9 Billion words . We trained on standard language structure only, and below is list of data we trained on . The model was trained using GPT 2's GitHub repository on a V3-8 TPU . You can use this model by installing torch or tensorflow and . Huggingface library transformers . And you can use it directly by initializing it like this: Initializing it directly . The output is, 'Pretrained-model/gpt2.model' and 'Output: Pretraining-model.model.pretrained.possible.m.,