# belebele by AI at Meta: AI Training Dataset Source: https://savrn.com/datasets/belebele Markdown alternate of the page above; the site index is https://savrn.com/llms.txt --- ## Dataset Card By AI at Meta, published under cc-by-sa-4.0, revision 7899cdfa4e1e. ### The Belebele Benchmark for Massively Multilingual NLU Evaluation Belebele is a multiple-choice machine reading comprehension (MRC) dataset spanning 122 language variants. This dataset enables the evaluation of mono- and multi-lingual models in high-, medium-, and low-resource languages. Each question has four multiple-choice answers and is linked to a short passage from the [FLORES-200](https://github.com/facebookresearch/flores/tree/main/flores200) dataset. The human annotation procedure was carefully curated to create questions that discriminate between different levels of generalizable language comprehension and is reinforced by extensive quality checks. While all questions directly relate to the passage, the English dataset on its own proves difficult enough to challenge state-of-the-art language models. Being fully parallel, this dataset enables direct comparison of model performance across all languages. Belebele opens up new avenues for evaluating and analyzing the multilingual abilities of language models and NLP systems. [Read the full dataset card (1,750 words)](https://savrn.com/datasets/belebele/card) ## Structure ### acm_Arab 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 1.0 MB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### afr_Latn 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 746.0 KB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### als_Latn 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 817.8 KB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### amh_Ethi 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 1.1 MB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### apc_Arab 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 990.8 KB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### arb_Arab 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 1.0 MB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### arb_Latn 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 769.4 KB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### ars_Arab 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 1.0 MB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### ary_Arab 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 1.0 MB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### arz_Arab 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 1.0 MB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### asm_Beng 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 1.6 MB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ### azj_Latn 900 rows | Split | Rows | Size | | --- | --- | --- | | test | 900 | 851.8 KB | linkstringquestion_numberint64flores_passagestringquestionstringmc_answer1stringmc_answer2stringmc_answer3stringmc_answer4stringcorrect_answer_numstringdialectstringdstimestamp[s] ## Details Repository facebook/belebele Publisher AI at Meta Task category Question answering Tags Not stated by the source Size category 100K