pucpr/gpt2-bio-pt

GPT2-BioPT (Portuguese Biomedical GPT-2 small) is a language model for Portuguese Biomedical . It was introduced in this paper and first released at this page (February 14, 2019) It was trained to guess the next word in sentences . The model uses internally a mask-mechanism to make sure the predictions for the token i only uses the . inputs from 1 to i but not the future tokens . This way, the model learns an inner representation of the English language that can then be used to extract features useful for downstream tasks . The Hugging Face team also wrote a model card for their model . Content from this model card has been written by,