mrm8488/electra-small-finetuned-squadv2

Electra-small-discriminator fine-tuned on SQUAD v2.0 dataset for Q&A downstream task . Electra is a new method for self-supervised language representation learning . It can be used to pre-train transformer networks using relatively little compute . At large scale, ELECTRA achieves state-of-the-art results on the SQuAD 2.0 datasets . The model was trained on a Tesla P100 GPU and 25GB of RAM with the following command:python transformers/examples/question-answering/run_squad.py . To do well, systems must not only answer questions when possible, but also determine when,