dumitrescustefan/bert-base-romanian-cased-v1

The BERT base, cased model for Romanian, trained on a 15GB corpus, version . The model is trained on the following corpora (stats in the table below are after cleaning) The baseline is the Multilingual BERT model bert-base-multilingual-(un)cased, as at the time of writing it was the only available Bert model that works on Romanian . We'd like to thank Sampo Pyysalo from TurkuNLP for helping us out with the compute needed to pretrain the v1.0 BERT models. He's awesome! We're happy to use the model to train the model on a corpus of words, words and phrases,