Gopher (280B)
DeepMindLanguage modelingQuestion answering
Gopher (280B) is a language modeling model from DeepMind released in 2021 with 280000000000.0 parameters.
About Gopher (280B)
We enhance auto-regressive language models by conditioning on document chunks retrieved from a large corpus, based on local similarity with preceding tokens. With a 2 trillion token database, our Retrieval-Enhanced Transformer (RETRO) obtains compara
Details
- Provider
- DeepMind
- Task
- Language modeling,Question answering
- Parameters
- 280000000000.0
- Released
- 2021-12-08
- Open weights
- No