textattack/albert-base-v2-CoLA

The model was fine-tuned for 5 epochs with a batch size of 32, a learning rate of 3e-05, and a maximum sequence length of 128 . The best score the model achieved on this task was 0.824545445845829338447, as measured by the eval set accuracy, found after 2 epochs . TextAttack was trained with a cross-entropy loss function, and the data was loaded using the nlp library . For more information, check out TextAttack on Github and the model is available on the site of the TextAttack Model Card and the glue dataset loaded using nlp.icio.com.com/textAttack .,