Geotrend/bert-base-10lang-cased

We are sharing smaller versions of bert-base-multilingual-cased that handle a custom number of languages . This model handles the following languages: english, french, spanish, german, chinese, arabic, russian, portuguese, italian, and urdu . It is 22.5% smaller in size than the original version of distilbert-base . For more information please visit our paper: Load What You Need: Smaller Versions of Multilingual BERT. It produces the same representations as the original model which preserves the original accuracy. To generate other smaller versions please visit the Github repo. Please contact amine@geotrend,