Capreolus/electra-base-msmarco

The ELECTRA-Base model is fine-tuned on the MS MARCO passage classification task . It is intended to be used as a ForSequenceClassification model, but requires some modification since it contains a BERT classification head rather than the standard ELECTRA classification head . See the TFElectraRelevanceHead in the Capreolus BERT-MaxP implementation for a usage example . Please cite the PARADE paper if you use these weights . It was converted from the released TFv1 checkpoint . It corresponds to the ELECTRA model used to initialize PARADE (ELECTRA) in PARADE: Passage Representation Aggregation for Document Reranking by Li,