DeepPavlov/rubert-base-cased-conversational

RuBERT was trained on OpenSubtitles[1], Dirty, Pikabu and a Social Media segment of Taiga corpus[2]. We assembled a new vocabulary for Conversational RuberT model on this data and initialized the model . We used a new model to train the model on the data and use it to learn more about the Taiga tree tree . The model is based on a Russian, cased, 12-layer, 768‑hidden, 12‑heads, 180M parameters [rubert-base-cased-conversational] model [RuBERT] and a social media segment [Social Media] segment [social media] segment[2] The,