dbmdz/distilbert-base-german-europeana-cased

The MDZ Digital Library team (dbmdz) at the Bavarian State purposefullyLibrary open sources a German Europeana DistilBERT model . The final training corpus has a size of 51GB and consists of 8,035,986,369 tokens . The model is based on the open source Europeana newspapers provided by The European Library . For more information about the data and pretraining steps can be found in this repository . For questions about our Europeana BERT, ELECTRA and ConvBERT models just open a new discussion about the model here . The Hugging Face model hub is available on the Huggingface model hub. For more details about the training steps and results can be,