hfl/rbt6

Chinese pre-trained BERT with Whole Word Masking for Chinese BERTYiming Cui, Wanxiang Che, Ting Liu, Bing Qin, Ziqing Yang, Shijin Wang, Guoping Hu Hu . This repository is developed based on a re-trained 6-layer RoBERTa-wwm-ext model . The repository is based on the Chinese BERT series, MacBERT, XLNet and TextBrewer . If you find the technical report or resource is useful, please cite the following technical report in your paper: Cui, Yiming and Che, Wan xiang and Liu, Ting and Qin, Wang,