deep-learning-analytics/wikihow-t5-small

This is a T5-small model trained on Wikihow All data set . The model was trained for 3 epochs using a batch size of 16 and learning rate of 3e-4 . Model attained a Rouge1 score of 31.2 and RougeL score of 24.5.5 . We have written a blog post that covers the training procedure. Please find it here. Use the model to test your knowledge of the data set. The model is based on a data set trained for three epochs. Max_input_length is set as 512 and max_output_length is 150. Model is trained on a batch of 16 epochs and learning rates of 3,