distilbert-base-cased-distilled-squad

This model is a fine-tune checkpoint of DistilBERT-base-cased, fine-tuned using (a second step of) knowledge distillation on SQuAD v1.1 . This model reaches a F1 score of 87.1 on the dev set (for comparison, BERT bert-base cased version reaches a . comparison, for comparison, the . BERT-base .cased version reached a . F1 scores of 88.7 on dev set, compared to a BERT version of . Bert-Base-Cased version reaching a . 88.8 on the . dev set . The BERT model is . fine-,