funnel-transformer/medium-base

The team releasing Funnel Transformer did not write a model card for this model so this model card has been written by the Hugging Face team . This model is uncased: it does not make a difference between English and English . The model does not contain the decoder, so it ouputs hidden states that have a sequence length of one fourth of the inputs . It's good to use for tasks requiring a summary of the sentence (like sentence classification) but not if you need one input per initial token . You can use the raw model to extract a vector representation of a given text, but it's mostly intended to be fine-tuned on tasks that use the whole sentence .,