textattack/distilbert-base-uncased-CoLA

The model was fine-tuned for 5 epochs with a batch size of 64, a learning rate of 3e-05, and a maximum sequence length of 128 . The best score the model achieved on this task was 0.823585858101629914, as measured by the eval set accuracy, found after 2 epochs . TextAttack was trained with a cross-entropy loss function and the data was loaded using the nlp library . For more information, check out TextAttack on Github and the model is available on the site of the TextAttack Model Card and the glue dataset loaded using nlp.icio.com.com . To download the code,,