DeBERTa
MicrosoftLanguage modeling/generationQuestion answeringOpen weights
The DeBERTa model is an open-weights language modeling/generation model from Microsoft with 1500000000.0 parameters.
About DeBERTa
Recent progress in pre-trained neural language models has significantly improved the performance of many natural language processing (NLP) tasks. In this paper we propose a new model architecture DeBERTa (Decoding-enhanced BERT with disentangled atte
Details
- Provider
- Microsoft
- Task
- Language modeling/generation,Question answering
- Parameters
- 1500000000.0
- Released
- 2021-06-10
- Open weights
- Yes