prajjwal1/bert-tiny

Pytorch pre-trained model obtained from converting Tensorflow checkpoint found in official Google BERT repository . These BERT variants were introduced in the paper Well-Read Students Learn Better: On the Importance of Pre-training Compact Models . These models are supposed to be trained on a downstream task . You can check out:. referior prajjwal1/bert-tiny (L=2, H=128)receive-pre-trained models from converting . The model is a pre-training model found in the official Google . BERT variant was introduced in an article published in the . Well-read students learn better: On . the importance of Pre,