cook/cicero-similis

A Latin Language Model trained on classical Latin texts that are reasonably close to Cicero's range of vocabulary as described in the forthcoming paper "What Would Cicero Write?" A paper will be published in Cicero Digitalis in 2021 . Normalize text using JV Replacement and tokenize using CLTK to separate enclitics such as "que", then: transformers import BertForMaskedLM, AutoTokenizer, FillMaskPipeline to fill_mask . The model is biased towards Cicero, but that weakness is the model's strength; it's not aimed to be a one-size fits all model . The training procedure includes .5 epochs, masked language modeling .,