DeLighT
University of WashingtonAllen Institute for AIFacebook AI ResearchLanguage modelingTranslation
Developed by University of Washington,Allen Institute for AI,Facebook AI Research in 2020, DeLighT is a language modeling model with 99000000.0 parameters.
About DeLighT
We introduce a deep and light-weight transformer, DeLighT, that delivers similar or better performance than standard transformer-based models with significantly fewer parameters. DeLighT more efficiently allocates parameters both (1) within each Tran
Details
- Provider
- University of Washington,Allen Institute for AI,Facebook AI Research
- Task
- Language modeling,Translation
- Parameters
- 99000000.0
- Released
- 2020-08-03
- Open weights
- No