Translation Datasets
There are 50 translation datasets in our directory. Each links to its source, paper, and download — browse the full list below or filter by language.
Translation is the task of converting text from one natural language into another while preserving meaning. We catalog 50 datasets for it.
- ai4bharat/samanantarText Generation, TranslationEN, AS, BN
- ai4privacy/pii-masking-200kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- ai4privacy/pii-masking-300kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- ai4privacy/pii-masking-400kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- arxiv-community/arxiv_datasetTranslation, Summarization, Text RetrievalEN
- bh2821/LightNovel5000Text Generation, TranslationZH, EN
- bible-nlp/biblenlp-corpusTranslationAAI, AAK, AAU
- CohereLabs/aya_collectionText Classification, Summarization, TranslationACE, AFR, AMH
- community-datasets/tapacoTranslation, Text ClassificationAF, AR, AZ
- deepmind/code_contestsTranslationEN
- dennlinger/eur-lex-sumTranslation, SummarizationBG, HR, CS
- espnet/yodas-granaryAutomatic Speech Recognition, TranslationBG, CS, DA
- facebook/bouquetTranslationAA, AAR, ABL
- facebook/floresText Generation, TranslationACE, ACM, ACQ
- FBK-MT/MCIFAutomatic Speech Recognition, Question Answering, Summarization, Visual Question Answering, TranslationEN, DE, IT
- gajeshladhar/core-fiveImage Segmentation, Image Classification, Object Detection, Image To Text, Image To Image, Translation, Summarization, Feature Extraction, Unconditional Image GenerationEN
- gauduc/ulatroiVideo Classification, Automatic Speech Recognition, TranslationVI, ZH
- google/code_x_glue_ct_code_to_textTranslationCODE, EN
- google/smolTranslationAA, AB, ABQ
- google/wmt24ppTranslationAR, BG, BN
- gsarti/flores_101Text Generation, TranslationAF, AM, AR
- Helsinki-NLP/europarlTranslationBG, CS, DA
- Helsinki-NLP/fineweb-edu-translatedTranslation, Text GenerationBOS, BUL, CAT
- Helsinki-NLP/nemotron-cc-translatedTranslation, Text GenerationBOS, BUL, CAT
- Helsinki-NLP/news_commentaryTranslationAR, CS, DE
- Helsinki-NLP/open_subtitlesTranslationAF, AR, BG
- Helsinki-NLP/opus_booksTranslationCA, DE, EL
- Helsinki-NLP/opus-100TranslationAF, AM, AN
- Helsinki-NLP/tatoebaTranslationAB, ACM, ADY
- Helsinki-NLP/tatoeba_mtText Generation, TranslationAF, AR, AZ
- How2Speech-to-Text, Translation, Summarization, VisualPortuguese, English
- HPLT/DocHPLTTranslationAF, AR, AZ
- HuggingFaceFW/finetranslationsText Generation, TranslationABK, ABQ, ABS
- IWSLT/iwslt2017TranslationAR, DE, EN
- JDhruv14/Bhagavad-Gita_DatasetTranslation, Text Generation, Feature ExtractionHI, SA, EN
- lmg-anon/vntl-leaderboardTranslationEN, JA
- M-A-D/Mixed-Arabic-Datasets-RepoText Classification, Question Answering, Translation, Summarization, Text Generation, Fill MaskAR
- NilanE/ParallelFiction-Ja_En-100kTranslationJA, EN
- NTU-NLP-sg/xCodeEvalTranslation, Token Classification, Text Retrieval, Text Generation, Text Classification, Feature Extraction, Question AnsweringCODE, EN
- nvidia/GranaryAutomatic Speech Recognition, TranslationBG, CS, DA
- openlanguagedata/flores_plusText Generation, TranslationACE, ACM, ACQ
- reciTAL/mlsumSummarization, Translation, Text ClassificationDE, ES, FR
- rqq/GLM-4-Instruct-4K-zhTranslation, Question AnsweringZH
- Targoman/TLPCQuestion Answering, Text Classification, Translation, Summarization, Text GenerationFA
- visheratin/laion-coco-nllbImage To Text, TranslationACE, ACM, ACQ
- wmt/wmt_t2tTranslationDE, EN
- wmt/wmt14TranslationCS, DE, EN
- wmt/wmt19TranslationCS, DE, EN
- xmj2002/Chinese_modern_classicalTranslationZH
- zetavg/coct-en-zh-tw-translations-twp-300kTranslation, Text GenerationZH, EN