facebook/s2t-small-mustc-en-pt-st

The S2T-SMALL-MUSTC-EN-PT-ST is a Speech to Text Transformer (S2T) model trained for end-to-end Speech Translation (ST) It uses a convolutional downsampler to reduce the length of speech inputs by 3/4th before they are fed into the encoder . The model is trained with standard autoregressive cross-entropy loss and generates the transcripts autoregressively . This model can be used for English speech to Portuguese text translation . It is trained on English-Portuguese subset of MuST-C, a multilingual speech translation corpus whose size and quality facilitates the training of end,