vinai/bertweet-covid19-base-uncased

BERTweet is the first public large-scale language model pre-trained for English Tweets . It is trained based on the RoBERTa pre-training procedure, using the same model configuration as BERT-base . The corpus used to pre-train Bertweet consists of 850M Tweets (16B word tokens ~ 80GB), containing 845M Tweets streamed from 01/2012 to 08/2019 . The general architecture and experimental results can be found in our paper: The paper is published in the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations . For further information or requests, please go to the BERTTweet's homepage!,