distilbert-base-uncased-distilled-squad

This model is a fine-tune checkpoint of DistilBERT-base-uncased, fine-tuned using (a second step of) knowledge distillation on SQuAD v1.1 . This model reaches a F1 score of 86.9 on the dev set (for comparison, Bert bert-base uncased version reaches a . comparison, . for comparison, the Bert-base .uncased version reached a . 88.5 on the . dev set . [DistilberT base uncased [SQuAD] is a . fine-toned (second step) of (knowledge distillation) on (a . second step (a) knowledge,