Transformer-XL Large + Phrase Induction
Massachusetts Institute of Technology (MIT)University of Illinois Urbana-Champaign (UIUC)Language modeling/generation
Transformer-XL Large + Phrase Induction is a language modeling/generation model from Massachusetts Institute of Technology (MIT),University of Illinois Urbana-Champaign (UIUC) released in 2019 with 256999999.99999997 parameters.
About Transformer-XL Large + Phrase Induction
Common language models typically predict the next word given the context. In this work, we propose a method that improves language modeling by learning to align the given context and the following phrase. The model does not require any linguistic ann
Details
- Provider
- Massachusetts Institute of Technology (MIT),University of Illinois Urbana-Champaign (UIUC)
- Task
- Language modeling/generation
- Parameters
- 256999999.99999997
- Released
- 2019-06-04
- Open weights
- No