ELECTRA
Stanford UniversityGoogleGoogle BrainText autocompletionOpen weights
ELECTRA is text autocompletion model published by Stanford University,Google,Google Brain in 2020 featuring 335000000.0 parameters.
About ELECTRA
Masked language modeling (MLM) pre-training methods such as BERT corrupt the input by replacing some tokens with [MASK] and then train a model to reconstruct the original tokens. While they produce good results when transferred to downstream NLP task
Details
- Provider
- Stanford University,Google,Google Brain
- Task
- Text autocompletion
- Parameters
- 335000000.0
- Released
- 2020-03-23
- Open weights
- Yes