Recognai/distilbert-base-es-multilingual-cased

The Spanish extract of distilbert-base-multilingual-cased is a distilled version of the BERT base multilingual model . This model is cased: it does make a difference between English and English . The resulting model has the same architecture as DistilmBERT: 6 layers, 768 dimension and 12 heads, with a total of 63M parameters . The goal of this model is to reduce even further the size of the DistilberT model by selecting only most frequent tokens for Spanish . For more details visit the paper from the Geotrend team: Load What You Need: Smaller Versions of Multilingual BERT [https://huggingface.co,