RoFormer
Zhuiyi TechnologyText classificationLanguage modeling/generation
RoFormer is text classification model published by Zhuiyi Technology in 2023 featuring 110000000.0 parameters.
About RoFormer
Position encoding recently has shown effective in the transformer architecture. It enables valuable supervision for dependency modeling between elements at different positions of the sequence. In this paper, we first investigate various methods to in
Details
- Provider
- Zhuiyi Technology
- Task
- Text classification,Language modeling/generation
- Parameters
- 110000000.0
- Released
- 2023-11-08
- Open weights
- No