ckiplab/gpt2-base-chinese

Chinese transformers models (including ALBERT, BERT, GPT2) and NLP tools (including word segmentation, part-of-speech tagging, named entity recognition) Please use BertTokenizerFast as tokenizer instead of AutoTokenizer . For full usage and more information, please refer to https://://://github.com/ckiplab/ckip-transformers.org/gpt2-base-chinese/coding-language-support-flow-free-to-the-source . For more information on the project, please visit http://www.codingblockers-free.org.uk/CKIP Gpt2,