Transformer-XL + RMS dynamic eval
University of EdinburghLanguage modeling/generation
Transformer-XL + RMS dynamic eval is language modeling/generation model published by University of Edinburgh in 2019 featuring 256999999.99999997 parameters.
About Transformer-XL + RMS dynamic eval
This research note combines two methods that have recently improved the state of the art in language modeling: Transformers and dynamic evaluation. Transformers use stacked layers of self-attention that allow them to capture long range dependencies i
Details
- Provider
- University of Edinburgh
- Task
- Language modeling/generation
- Parameters
- 256999999.99999997
- Released
- 2019-04-17
- Open weights
- No