voidful/albert_chinese_tiny

Albert_chinese_tiny is a model from brightmart/albert_zh project, albert_tiny_google_zh model converted by huggingface's script . Since sentencepiece is not used, we have to call BertTokenizer instead of AlbertTokenizer !!! We can eval it using an example on MaskedLM . The result is 0.40312355355756759644 . The model is a 'voidful' model that has been converted to a 'minimal' model . It is based on a model that is called AlbertForMaskedLM and has been used in the previous version of the above article . We can now use the model to evaluate it,