AWD-LSTM+WT+Cache+IOG (WT2)
NTT Communication Science LaboratoriesLanguage modeling
Developed by NTT Communication Science Laboratories in 2017, AWD-LSTM+WT+Cache+IOG (WT2) is a language modeling model with 53000000.0 parameters.
About AWD-LSTM+WT+Cache+IOG (WT2)
This paper proposes a reinforcing method that refines the output layers of existing Recurrent Neural Network (RNN) language models. We refer to our proposed method as Input-to-Output Gate (IOG). IOG has an extremely simple structure, and thus, can be
Details
- Provider
- NTT Communication Science Laboratories
- Task
- Language modeling
- Parameters
- 53000000.0
- Released
- 2017-09-26
- Open weights
- No