Wikidepia/IndoT5-large

IndoT5 only pretrained on denoising task, fine-tuning is still needed . It's available in three sizes (small, base and large) Trained 300k steps and trained on various corpus . It is pretrained using script provided by unicamp-dl on PTT5 Repository. Trained on various Corpus. It is available in small (small) and large (base) sizes (Small, base, large) It is only pretrainable to denoise tasks. It's only pre-trained on denoiseising task. It has been trained on training data from various corpus. The training data is available for pre-training purposes only to pre-,