lvwerra/gpt2-imdb

The GPT2 language model was fine-tuned for 1 epoch on the IMDB dataset . All comments were joined into a single text file separated by the EOS token . The run_language_modeling.py script in the transformer library was used to train the model . The model was trained using the language language model gpt2 (gpt2) and the data file imdb.txt . The data file was used for training the model on a single epoch on IMDB. The model is trained using pandas and the model was then trained on an IMDB data file with the help of the language model. The code was then used to analyze the model's behaviour .,