madlag/bert-base-uncased-squadv1-x1.96-f88.3-d27-hybrid-filled-opt-v1

The model was fine-tuned from the HuggingFace BERT base uncased checkpoint on SQuAD1.1, and distilled from the model bert-large-uncased-whole-word-masking-finetuned-squad . It is case-insensitive: it does not make a difference between English and English . The model contains 43.0% of the original weights overall (the embeddings account for a significant part of the model, and they are not pruned by this method). With a simple resizing of the linear matrices it ran 1.96x as fast as BERT-base on the evaluation. The model is case,