Feedback Transformer
LORIAUniversity of LorraineFacebook AI ResearchLanguage modeling
Developed by LORIA,University of Lorraine,Facebook AI Research in 2020, Feedback Transformer is a language modeling model with 126000000.0 parameters.
About Feedback Transformer
Transformers have been successfully applied to sequential, auto-regressive tasks despite being feedforward networks. Unlike recurrent neural networks, Transformers use attention to capture temporal relations while processing input tokens in parallel.
Details
- Provider
- LORIA,University of Lorraine,Facebook AI Research
- Task
- Language modeling
- Parameters
- 126000000.0
- Released
- 2020-02-21
- Open weights
- No