google/t5-xxl-ssm-tqa

The model was pre-trained using T5's denoising objective on C4 . Pre-trained with REALM's salient span masking objective on Wikipedia . Fine-tuned on 100% of the train splits of Trivia QA (TQA) for 10 steps . The model can be used as follows as follows for closed book question answering: t5_qa_model = AutoModelForSeq2SeqLM, AutoTokenizer.from_pretrained("google/t5-xxl-ssm-tqa") T5-11b: T5 QA QA T5 T5 11b T5 X5-X5-,