Wikidepia/IndoT5-small

IndoT5 only pretrained on denoising task, fine-tuning is still needed . It's available in three sizes (small, base and large) Trained 500k steps . It is pretrained using script provided by unicamp-dl on PTT5 Repository. Trained on various corpus. It is available in small, base, large (small) sizes (large) and large (pre-trained) It's now available in pre-trained versions of OSCAR Corpus. It's also available in large and small versions of OpenSubtitle (OpenSubtitle, Tanzil, etc) and smaller versions of TPU. It was trained on various Corpus Corpus.,