Skip to content

S4

Stanford UniversityLanguage modeling/generationOpen weights

Developed by Stanford University in 2021, S4 is a language modeling/generation model with 249000000.00000003 parameters with openly available weights.

About S4

A central goal of sequence modeling is designing a single principled model that can address sequence data across a range of modalities and tasks, particularly on long-range dependencies. Although conventional models including RNNs, CNNs, and Transfor

Details

Provider
Stanford University
Task
Language modeling/generation
Parameters
249000000.00000003
Released
2021-10-31
Open weights
Yes
View model source

Explore

FAQ