base LM+GNN+kNN
Shannon.AINanjing UniversityNanyang Technological UniversityZhejiang University (ZJU)Language modelingOpen weights
The base LM+GNN+kNN model is an open-weights language modeling model from Shannon.AI,Nanjing University,Nanyang Technological University,Zhejiang University (ZJU) with 274000000.0 parameters.
About base LM+GNN+kNN
Inspired by the notion that ``{\it to copy is easier than to memorize}``, in this work, we introduce GNN-LM, which extends the vanilla neural language model (LM) by allowing to reference similar contexts in the entire training corpus. We build a dire
Details
- Provider
- Shannon.AI,Nanjing University,Nanyang Technological University,Zhejiang University (ZJU)
- Task
- Language modeling
- Parameters
- 274000000.0
- Released
- 2021-10-17
- Open weights
- Yes