maurice/PolitBERT

PolitBERT was created to specialize on political speeches, interviews and press briefings of English-speaking politicians . The model was trained on the standard MLM task with default parameters and learning rate was 5e-5 with a linearly decreasing schedule and AdamW. The used batch size is 8 per GPU while beeing trained on two Nvidia GTX TITAN X. The data was split up into single sentences, which has been split up in single sentences:https://www.kaggle.com/mauricerupp/English-speaking-politicians-types-predicting-speakers-and-pressing-press briefings . To predict a missing word of a sentence, the,