gpt2

GPT-2 is a transformers model pretrained on a very large corpus of English data in a self-supervised fashion . It was trained to guess the next word in sentences using a causal language modeling objective . The model learns an inner representation of the English language that can then be used to extract features that are useful for downstream tasks . You can use the raw model for text generation or fine-tune it to a downstream task. See the model hub to look for fine-tuned versions on a task that interests you. The model is best at what it was pretrained for however, which is generating texts from a pre-training corpus of text . The team releasing GPT,