data2vec (language)
Meta AILanguage modeling/generationOpen weights
The data2vec (language) model is an open-weights language modeling/generation model from Meta AI with 705134592.0 parameters.
About data2vec (language)
While the general idea of self-supervised learning is identical across modalities, the actual algorithms and objectives differ widely because
they were developed with a single modality in mind. To get us closer to general self-supervised learning, we
Details
- Provider
- Meta AI
- Task
- Language modeling/generation
- Parameters
- 705134592.0
- Released
- 2022-01-20
- Open weights
- Yes