ALBERT
Toyota Technological Institute at ChicagoGoogle ResearchLanguage modeling/generationQuestion answeringOpen weights
ALBERT is language modeling/generation model published by Toyota Technological Institute at Chicago,Google Research in 2019 featuring 18000000.0 parameters.
About ALBERT
Increasing model size when pretraining natural language representations often results in improved performance on downstream tasks. However, at some point further model increases become harder due to GPU/TPU memory limitations and longer training time
Details
- Provider
- Toyota Technological Institute at Chicago,Google Research
- Task
- Language modeling/generation,Question answering
- Parameters
- 18000000.0
- Released
- 2019-09-26
- Open weights
- Yes