allenai/wmt16-en-de-dist-12-1

This is a ported version of fairseq-based wmt16 transformer for en-de . For more details, please, see Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation . The BLEU scores are slightly below the score reported in the paper, as the researchers don't use sacrebleu and measure the score on tokenized outputs . Pretrained weights were left identical to the original model released by allenai . The score was calculated using this code:git clone https://github.com/huggingface/transformers/translated-translating-language-free-translate-translated .,