funnel-transformer/xlarge-base

The team releasing Funnel Transformer did not write a model card for this model so this model card has been written by the Hugging Face team . This model is uncased: it does not make a difference between English and English . The model does not contain the decoder, so it ouputs hidden states that have a sequence length of one fourth of the inputs . It's good to use for tasks requiring a summary of the sentence (like sentence classification) but not if you need one input per initial token, you should use the xlarge model in that case . The BERT model was pretrained on:.BookCorpus, a dataset consisting of 11,038 unpublished books,