SEBIS/legal_t5_small_trans_cs_es

The legal_t5_small_trans_cs_es model is based on the t5-small model and was trained on a large corpus of parallel text . It scales the baseline model of t5 down by using dmodel = 512, dff = 2,048, 8-headed attention, and only 6 layers each in the encoder and decoder . This variant has about 60 million parameters . The model could be used for translation of legal texts from Cszech to Spanish in PyTorch . It was first released in this repository in September 2013 . It is a smaller model, which scales the . baseline model down . by using using d model of . t5 .,