UL2
Google ResearchGoogle BrainLanguage modeling/generationQuestion answeringText summarizationOpen weights
Developed by Google Research,Google Brain in 2022, UL2 is a language modeling/generation model with 20000000000.0 parameters with openly available weights.
About UL2
Existing pre-trained models are generally geared towards a particular class of problems. To date, there seems to be still no consensus on what the right architecture and pre-training setup should be. This paper presents a unified framework for pre-tr
Details
- Provider
- Google Research,Google Brain
- Task
- Language modeling/generation,Question answering,Text summarization
- Parameters
- 20000000000.0
- Released
- 2022-05-10
- Open weights
- Yes