huseinzol05/tiny-bert-bahasa-cased

Tiny-BERT language model was distilled on 1.8 Billion words . We distilled on both standard and social media language structures . We use google/sentencepiece to train the tokenizer, so to use it, need to load from AlbertTokenizer . You can use this model by installing torch or tensorflow and Huggingface library transformers . And you can use it directly by initializing it like this: Initializing it directly . The output is, 'sequence': '[CLS] makan ayam dengan berbual[SEP]', 'score': 0.0001576954527990808925, 'token': 'token,