Base LM + kNN LM + Continuous Cache
Stanford UniversityFacebook AI ResearchLanguage modeling
Base LM + kNN LM + Continuous Cache is a language modeling model from Stanford University,Facebook AI Research released in 2019 with 247000000.00000003 parameters.
About Base LM + kNN LM + Continuous Cache
We introduce kNN-LMs, which extend a pre-trained neural language model (LM) by linearly interpolating it with a k-nearest neighbors (kNN) model. The nearest neighbors are computed according to distance in the pre-trained LM embedding space, and can b
Details
- Provider
- Stanford University,Facebook AI Research
- Task
- Language modeling
- Parameters
- 247000000.00000003
- Released
- 2019-11-01
- Open weights
- No