SEBIS/code_trans_t5_small_code_comment_generation_java_transfer_learning_finetune

CodeTrans model is based on the t5-small model architecture . It has its own SentencePiece vocabulary model . It used transfer-learning pre-training on 7 unsupervised datasets in the software development domain . It is then fine-tuned on the code comment generation task for the java function/method . This model is trained on tokenized java code functions: it works best with tokenized . java code . It can be used on unparsed and untokenized java . code . However, if the java code is tokenized, the performance should be better. It has a total of approximately 220M parameters and was trained using the encoder-decoder architecture .,