mrm8488/mobilebert-uncased-finetuned-squadv1

MobileBERT + SQuAD (v1.1) fine-tuned on SQUAD v2.0 dataset for Q&A downstream task . Model is a thin version of BERT_LARGE, while equipped with bottleneck structures and a carefully designed balance between self-attentions and feed-forward networks . Model was trained on a Tesla P100 GPU and 25GB of RAM with the following command:python transformers/examples/question-answering/run_squad.py . Model training was trained using the model was trained with the model . Model converges much faster than other ones, so it is also cheap to fine-tune .,