google/t5-11b-ssm-wqo

The model was fine-tuned on 90% of the train splits of Web Questions (WQ) for 20k steps . It was pre-trained using T5's denoising objective on C4 . The model can be used as follows for closed book question answering: t5_qa_model = AutoModelForSeq2SeqLM, AutoTokenizer. (T5-11b-ssm-wqo) The code and trained models are available at https://goo.gle/t5-cbqa.com/ . The code is available to download at http://www.huggingface.co/huggen-face.,