SEBIS/code_trans_t5_base_commit_generation_transfer_learning_finetune

This model is trained on tokenized git commit: it works best with tokenized commit . It can be used on unparsed and untokenized commit changes . It has a total of approximately 220M parameters and was trained using the encoder-decoder architecture . The model was then fine-tuned on a single TPU Pod V2-8 for 2,000 steps in total, using sequence length 512 (batch size 256) The model could be used to generate the git commit message for the . git commit . message for java commit changes or for other relevant tasks . The code-trans model is based on the t5-base model and has its own SentencePiece,