ayansinha/lic-class-scancode-bert-base-cased-L32-1

This model is intended to be used for Sentence Classification . It is a fine-tuned version of the bert-base-cased model . The BERT model was pretrained on BookCorpus, a dataset consisting of 11,038 unpublished books and English Wikipedia (excluding lists, tables and headers) It has the same biases, but as the task it is . is a very specific task (license text/notice/tag/referance) without those intended biases, it's safe to assume those . don't apply at all here . The model was fine-tunes with learning rate 2e-5 (60 secs each on an . RTX 2060),