dumitrescustefan/bert-base-romanian-uncased-v1

The BERT base, uncased model for Romanian, trained on a 15GB corpus, version . The baseline is the Multilingual BERT model bert-base-multilingual-(un)cased) The model is trained on the following corpora (stats in the table below are after cleaning): . The last hidden-state is the first element of the output tuples . Evaluation is performed on Universal Dependencies Romanian RRT UPOS, XPOS and LAS, and on a NER task based on RONEC. Details, as well as more in-depth tests not shown here, are given in the dedicated evaluation page . We'd like to thank Sampo,