funnel-transformer/small

The team releasing Funnel Transformer did not write a model card for this model so this model card has beenwritten by the Hugging Face team . The model is uncased: it does not make a difference between English and English . It was introduced in a paper and first released in the repository of this repository . This model was pretrained on a large corpus of English data in a self-supervised fashion . It can be used to train a standard classifier using the features produced by the BERT model as inputs . For tasks such as text generation you should look at model like GPT2. For task such as sequence classification or question answering, see the model hub to look for fine,