google/t5-3b-ssm-nq

The model was fine-tuned on 100% of the train splits of Natural Questions (NQ) for 10k steps . It was pre-trained using T5's denoising objective on C4 . The model can be used as follows for closed book question answering: t5_qa_model = AutoModelForSeq2SeqLM, AutoTokenizer.from_pretrained("google/t5-3b-ssm-nq") The model is now being used to answer questions without access to any external context or knowledge . To facilitate reproducibility and future work, we release our code and trained models at https://goo.gle/t,