voidful/albert_chinese_small

Albert_chinese_small is a model from brightmart/albert_zh project, albert_small_google_zh model, which was converted by huggingface's script . Since sentencepiece is not used in albert's small modelyou have to call BertTokenizer instead of AlbertTokenizer !!!we can eval it using an example on MaskedLM . The result is 0.6390823125839233 . The model is based on a model called AlbertForMaskedLM from the brightmart project, which has been used in the previous version of this article . We can now use the model to evaluate it using a new version of the model,