aliosm/ai-soco-cpp-roberta-tiny-96

The model can be used to do code classification, authorship identification and other downstream tasks on C++ programming language . The model was trained on Google Colab platform with 8 TPU cores for 200 epochs, 16*8 batch size, 512 max sequence length and MLM objective . Each continues 4 spaces were converted to a single tab character (\t) before tokenization. The model is limited to C++ language only. It can only be used for C++ code classification and authorship identifying . It can be pre-trained using AI-SOCO dataset which consists of C++ codes crawled from CodeForces website. It is only available for pre-training purposes only . The,