hfl/chinese-legal-electra-base-generator

Google and Stanford University have released a new pre-trained model called ELECTRA . It has a much compact model size and relatively competitive performance compared to BERT and its variants . ELECTRA-small could reach similar or even higher scores on several NLP tasks with only 1/10 parameters . The Joint Laboratory of HIT and iFLYTEK Research (HFL) has released the Chinese ELECTRA models based on the official code of ELECTRA. The new model is specifically designed for legal domain. The ELECTRA model is based on an earlier version of the Chinese BERT series and XLNet. The Chinese Electra model has been released to further accelerate the research of the model, the Joint,