neuralspace-reverie/indic-transformers-bn-xlmroberta

This is a XLMRoBERTa language model pre-trained on 3 GB of monolingual training corpus . The pre-training data was majorly taken from OSCAR . This model can be fine-tuned on downstream tasks like text-classification, POS-tagging, question-answering, etc. Embeddings from this model can also be used for feature-based training . The original language model has been trained using PyTorch and hence the use of pytorch_model.bin weights file is recommended . The h5 file for Tensorflow has been generated manually by commands suggested here . The model was used to generate the h5 h5,