microsoft/codebert-base

Pretrained weights for CodeBERT: A Pre-Trained Model for Programming and Natural Languages . The model is trained on bi-modal data (documents & code) of CodeSearchNet . It is trained with MLM+RTD objective (cf. the paper) Please see the official repository for scripts that support "code search" and "code-to-document generation" for "code to document generation" The author of the paper is Zhangyin Feng and Daya Guo and . Duyu Tang and . Nan Duan and Xiaocheng Feng and . Xiaoyng Feng . Ming Gong and Linjun Shou and . Bing Qin and Ting,