facebook/s2t-small-mustc-en-fr-st

S2T-SMALL-MUSTC-EN-FR-ST is a Speech to Text Transformer (S2T) model trained for end-to-end Speech Translation (ST) It uses a convolutional downsampler to reduce the length of speech inputs by 3/4th before they are fed into the encoder . The model is trained with standard autoregressive cross-entropy loss and generates the Transcripts/translations autoregressively . It is trained on English-French subset of MuST-C, a multilingual speech translation corpus whose size and quality facilitates the training of speech translation from English into several languages . This model can be used,