ml6team/mt5-small-german-finetune-mlsum

Model was fine-tuned on all German articles present in the train split of the MLSUM dataset having less than 384 "words" after splitting on whitespace, which resulted in 80249 articles . Model was finetuned for 3 epochs with a max_len (input) of 768 tokens and target_max_len of 192 tokens . It was evaluated on 2000 random articles from the validation set . Mean f1 ROUGE scores were calculated for both the fine-tuneed model and the lead-3 baseline (which simply produces the leading three sentences of the document) and are presented in the following table . The model was evaluated for both of the models and the baseline,