XLNet
Carnegie Mellon University (CMU)Google BrainLanguage modeling/generationQuestion answeringSentiment classificationOpen weights
Developed by Carnegie Mellon University (CMU),Google Brain in 2019, XLNet is a language modeling/generation model with 340000000.0 parameters with openly available weights.
About XLNet
With the capability of modeling bidirectional contexts, denoising autoencoding based pretraining like BERT achieves better performance than pretraining approaches based on autoregressive language modeling. However, relying on corrupting the input wit
Details
- Provider
- Carnegie Mellon University (CMU),Google Brain
- Task
- Language modeling/generation,Question answering,Sentiment classification
- Parameters
- 340000000.0
- Released
- 2019-06-01
- Open weights
- Yes