ALBERT-xxlarge
Toyota Technological Institute at ChicagoGoogleLanguage modeling/generationQuestion answeringOpen weights
ALBERT-xxlarge is language modeling/generation model published by Toyota Technological Institute at Chicago,Google in 2020 featuring 235000000.0 parameters.
About ALBERT-xxlarge
Increasing model size when pretraining natural language representations often results in improved performance on downstream tasks. However, at some point further model increases become harder due to GPU/TPU memory limitations and longer training time
Details
- Provider
- Toyota Technological Institute at Chicago,Google
- Task
- Language modeling/generation,Question answering
- Parameters
- 235000000.0
- Released
- 2020-02-09
- Open weights
- Yes