TransformerXL + spectrum control
University of California Los Angeles (UCLA)JD.comLanguage modeling
Developed by University of California Los Angeles (UCLA),JD.com in 2020, TransformerXL + spectrum control is a language modeling model with 151000000.0 parameters.
About TransformerXL + spectrum control
Recent Transformer-based models such as Transformer-XL and BERT have achieved huge success on various natural language processing tasks. However, contextualized embeddings at the output layer of these powerful models tend to degenerate and occupy an
Details
- Provider
- University of California Los Angeles (UCLA),JD.com
- Task
- Language modeling
- Parameters
- 151000000.0
- Released
- 2020-03-11
- Open weights
- No