mrm8488/t5-base-finetuned-wikiSQL

The model is first pre-trained on a data-rich task before being fine-tuned on a downstream task . The training script is a slightly modified version of this Colab Notebook created by Suraj Patil . To facilitate future work on transfer learning for NLP, we release our dataset, pre-training models, and code. To see more about this dataset and others in NLP ViewerModel.org: "T5-base-finetuned-Wiki-QML" The model was presented in Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer by Colin Raffel, Noam Shazeer, Adam Roberts, Katherine,