lannelin/bert-imdb-1hidden

A bert-base-uncased model was restricted to 1 hidden layer and fine-tuned for sequence classification on the  imdb dataset loaded using the datasets library . No special consideration given to limitations and bias given to the model's limitations and biases . The model was fine tuned for 1 epoch with a batch size of 64, a learning rate of 5e-5, and a maximum sequence length of 512. The accuracy on imdb test set: 0.87132. The model is based on the imdb dataset, loaded with the dataset library, and trained on the dataset using the library's training procedure . The training procedure was trained with a training period of 64,