mrm8488/t5-base-finetuned-quartz

The model was presented in Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer . Google's T5 fine-tuned on QuaRTz for QA downstream task . The training script is a slightly modified version of this awesome one by Suraj Patil . The question, context (para field) and options (choices field) are concatenated and passed to the encoder . The decoder receives the right answer (by querying answerKey field) More details about the dataset fields/format here . To facilitate future work on transfer learning for NLP, we release our dataset, pre-trained models, and code. The training,