sentence-transformers/ce-ms-marco-TinyBERT-L-6

This model uses TinyBERT, a tiny BERT model with only 6 layers . The base model is: General_TinyBERT_v2(6layer-768dim) It was trained on MS Marco Passage Ranking task . The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch) Then sort the passages in a decreasing order . The training code is available here: SBERT.net Training MS Marco with the training code . Pre-trained models can also be used like this: Pre- trained models are based on the TREC Deep Learning 2019 and the MSMarco Passage R,