vinai/phobert-large

PhoBERT pre-trained models are the state-of-the-art language models for Vietnamese (Pho, i.e. "Phở", is a popular food in Vietnam): Two PhoberT versions of "base" and "large" are the first public large-scale monolingual language models pre-training for Vietnamese . PhoBerT outperforms previous multilingual and multilingual approaches . The general architecture and experimental results can be found in our EMNLP-2020 Findings paper: Findings are published .Installation Python 3.6+ and PyTorch 1.1.0+ (or TensorFlow 2.0+),