MoE-Multi
Jagiellonian UniversityGoogle BrainLanguage modelingTranslation
Developed by Jagiellonian University,Google Brain in 2017, MoE-Multi is a language modeling model with 8700000000.0 parameters.
About MoE-Multi
The capacity of a neural network to absorb information is limited by its number of parameters. Conditional computation, where parts of the network are active on a per-example basis, has been proposed in theory as a way of dramatically increasing mode
Details
- Provider
- Jagiellonian University,Google Brain
- Task
- Language modeling,Translation
- Parameters
- 8700000000.0
- Released
- 2017-01-23
- Open weights
- No