DeepPavlov/bert-base-cased-conversational

We used this training data to build the vocabulary of English subtokens . We took English cased version of the BERT‑base as an initialization for English Conversational BERT . The training data was trained on the English part of Twitter, Reddit, DailyDialogues[1], OpenSubtitles[2], Debates[3], Blogs[4], Facebook News Comments[4] and Daily Dialogue[1] were trained on this data . The data was used to build a vocabulary of vocabulary for English subtitles . We used the data to create a vocabulary for conversational subtitled subtitles . We are happy to provide an overview of the training data for the next year,