indobenchmark/indobert-lite-large-p2

The pretrained model is trained using a masked language modeling (MLM) objective and next sentence prediction (NSP) objective . IndoBERT was trained and evaluated by Bryan Wilie, Karissa Vincentio, Genta Indra Winata, Samuel Cahyawijaya, Xiaohong Li, Zhi Yuan Lim, Sidik Soleman, Rahmad Mahendra, Pascale Fung, Syafri Bahar, Ayu Purwarianti . The model is based on the BERT language model for Indonesian based on BERT model . The training data includes data from BERT and AutoModel tokenizer . The data includes a pre-trained model and token,