smanjil/German-MedBERT

This is a fine-tuned model on Medical domain for German language and based on German BERT . This model has only been trained to improve on target task (Masked Language Model) It can later be used to perform downstream task of your needs . It can also be used for NTS-ICD-10 text classification task, while I performed it for . NTS-ICD-10 classification task . We fine-tuned using Pytorch with Huggingface library on Colab GPU . We had to train for upto 25 epochs for classification . We used standard parameter settings for fine .tuning as mentioned in original BERT's paper . Although had to . train for,