funnel-transformer/intermediate-base

The team releasing Funnel Transformer did not write a model card for this model so this model card has been written by the Hugging Face team . This model is uncased: it does not make a difference between English and English . It does not contain the decoder, so it ouputs hidden states that have a sequence length of one fourth of the inputs . The model is primarily aimed at being fine-tuned on tasks that use the whole sentence (potentially masked)to make decisions, such as sequence classification, token classification or question answering . For tasks such as text-generation you should look at model like GPT2. See the model hub to look for a fine-,