facebook/s2t-small-mustc-en-ru-st

The S2T-SMALL-MUSTC-EN-RU-ST is a Speech to Text Transformer (S2T) model trained for end-to-end Speech Translation (ST) The model is trained with standard autoregressive cross-entropy loss and generates the transcripts autoregressively . This model can be used for English speech to Russian text translation . It uses a convolutional downsampler to reduce the length of speech inputs by 3/4th before they are fed into the encoder . The model has been trained on English-Russian subset of MuST-C, a multilingual speech translation corpus whose size and quality facilitates the training of,