lordtt13/emo-mobilebert

MobileBERT is a thin version of BERT LARGE, trained on the EmoContext Dataset from scratch . It is 4.3x smaller and 5.5x faster than BERT_BASE while achieving competitive results on well-known benchmarks . On the SQuAD v1.1/v2.0 question answering task, MobileberT achieves a dev F1 score of 90.0/79.2 (1.5/2.1) On the natural language inference tasks of GLUE, MobileBERt achieves a GLUEscore o 77.7 (0.6 lower than the BERT model), and 62 ms latency on a Pixel 4,