ktrapeznikov/scibert_scivocab_uncased_squad_v2

Allenai/scibert_scivocab_uncased fine-tuned on SQuAD V2 using run_squad.py . The model is trained on 4 NVIDIA GeForce GTX 2080 Ti 2080s and has been trained on the dev set . I did not sweep for the best threshold. Training on SQAD allows the model to score if a paragraph contains an answer: start_scores.softmax(dim=1).log()[:,:,None] + end_score()[None,] # no answer scores[:,0,0] #no answer scores. #NoAns_exact.0.0 is training on,