C-Eval is a comprehensive Chinese evaluation suite for foundation models. It consists of 13948 multi-choice questions spanning 52 diverse disciplines and four difficulty levels. Please visit our website and GitHub or check our paper for more details.
Rows3,907
Configurations12
Size3.7 MB
Licensecc-by-nc-sa-4.0
AccessPublicly accessible
Monthly Downloads159k
Dataset Card
C-Eval is a comprehensive Chinese evaluation suite for foundation models. It consists of 13948 multi-choice questions spanning 52 diverse disciplines and four difficulty levels. Please visit our website and GitHub or check our paper for more details. Each subject consists of three splits: dev, val, and test. The dev set per subject consists of five exemplars with explanations for few-shot evaluation. The val set is intended to be used for hyperparameter tuning. And the test set is for model evaluation. More details on loading and using the data are at our github page. Please cite our paper if you use our dataset.
Excerpt from the card by Ceval, licensed cc-by-nc-sa-4.0.
Structure
accountant 497 rows
| Split | Rows | Size |
|---|---|---|
| test | 443 | 179.2 KB |
| val | 49 | 19.6 KB |
| dev | 5 | 3.4 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
advanced_mathematics 197 rows
| Split | Rows | Size |
|---|---|---|
| test | 173 | 50.9 KB |
| val | 19 | 5.3 KB |
| dev | 5 | 7.0 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
art_studies 336 rows
| Split | Rows | Size |
|---|---|---|
| test | 298 | 42.8 KB |
| val | 33 | 4.6 KB |
| dev | 5 | 1.4 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
basic_medicine 199 rows
| Split | Rows | Size |
|---|---|---|
| test | 175 | 29.7 KB |
| val | 19 | 2.6 KB |
| dev | 5 | 1.8 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
business_administration 339 rows
| Split | Rows | Size |
|---|---|---|
| test | 301 | 79.9 KB |
| val | 33 | 9.2 KB |
| dev | 5 | 3.2 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
chinese_language_and_literature 237 rows
| Split | Rows | Size |
|---|---|---|
| test | 209 | 33.4 KB |
| val | 23 | 3.4 KB |
| dev | 5 | 1.9 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
civil_servant 481 rows
| Split | Rows | Size |
|---|---|---|
| test | 429 | 183.7 KB |
| val | 47 | 21.3 KB |
| dev | 5 | 4.6 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
clinical_medicine 227 rows
| Split | Rows | Size |
|---|---|---|
| test | 200 | 43.2 KB |
| val | 22 | 4.2 KB |
| dev | 5 | 2.0 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
college_chemistry 253 rows
| Split | Rows | Size |
|---|---|---|
| test | 224 | 46.9 KB |
| val | 24 | 4.4 KB |
| dev | 5 | 3.6 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
college_economics 557 rows
| Split | Rows | Size |
|---|---|---|
| test | 497 | 122.3 KB |
| val | 55 | 14.5 KB |
| dev | 5 | 3.7 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
college_physics 200 rows
| Split | Rows | Size |
|---|---|---|
| test | 176 | 56.6 KB |
| val | 19 | 6.1 KB |
| dev | 5 | 3.8 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
college_programming 384 rows
| Split | Rows | Size |
|---|---|---|
| test | 342 | 85.3 KB |
| val | 37 | 9.5 KB |
| dev | 5 | 2.9 KB |
idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring
Details
- Repository
- ceval/ceval-exam
- Publisher
- Ceval
- Task category
- Text classification
- Tags
- Not stated by the source
- Size category
- 10K<n<100K
- Languages
- zh
- Revision
- 617524a00b307ff6f9933702f724131fe12ca7ce
- Last updated
- 2025-07-27
Files
158 files, 3.7 MB in total.
Data156 files · 3.7 MB
Documentation1 file · 40.1 KB
Repository1 file · 2.3 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| accountant/dev-00000-of-00001.parquet | Data | 9.9 KB | 8968397b45ec |
| accountant/test-00000-of-00001.parquet | Data | 120.9 KB | 37e61cdf5bf6 |
| accountant/val-00000-of-00001.parquet | Data | 20.5 KB | f99296e281ce |
| advanced_mathematics/dev-00000-of-00001.parquet | Data | 14.5 KB | 0a59067cde79 |
| advanced_mathematics/test-00000-of-00001.parquet | Data | 29.4 KB | a3758476b616 |
| advanced_mathematics/val-00000-of-00001.parquet | Data | 7.8 KB | e05ed87c1ea5 |
| art_studies/dev-00000-of-00001.parquet | Data | 6.5 KB | 0af5d1f91c37 |
| art_studies/test-00000-of-00001.parquet | Data | 33.4 KB | 17e9479ec724 |
| art_studies/val-00000-of-00001.parquet | Data | 7.5 KB | 8d7f0e954f19 |
| basic_medicine/dev-00000-of-00001.parquet | Data | 7.1 KB | ab699967a442 |
| basic_medicine/test-00000-of-00001.parquet | Data | 25.0 KB | 255dba5d3bfc |
| basic_medicine/val-00000-of-00001.parquet | Data | 6.1 KB | 41395a18f51c |
| business_administration/dev-00000-of-00001.parquet | Data | 10.0 KB | 7aec080858e7 |
| business_administration/test-00000-of-00001.parquet | Data | 54.6 KB | cb452864f24e |
| business_administration/val-00000-of-00001.parquet | Data | 11.8 KB | b897dc81b061 |
| chinese_language_and_literature/dev-00000-of-00001.parquet | Data | 6.6 KB | 2ace6a34b590 |
| chinese_language_and_literature/test-00000-of-00001.parquet | Data | 29.9 KB | 70d7d6f575a2 |
| chinese_language_and_literature/val-00000-of-00001.parquet | Data | 6.6 KB | 50f20440e7a7 |
| civil_servant/dev-00000-of-00001.parquet | Data | 13.1 KB | 3d55ffa82433 |
| civil_servant/test-00000-of-00001.parquet | Data | 145.2 KB | 015630aa00e7 |
| civil_servant/val-00000-of-00001.parquet | Data | 22.4 KB | 7018958b189d |
| clinical_medicine/dev-00000-of-00001.parquet | Data | 6.9 KB | aef59d638d0d |
| clinical_medicine/test-00000-of-00001.parquet | Data | 35.0 KB | 546522335722 |
| clinical_medicine/val-00000-of-00001.parquet | Data | 7.5 KB | c8d691d83dc2 |
| college_chemistry/dev-00000-of-00001.parquet | Data | 9.3 KB | 4b6a5f002562 |
| college_chemistry/test-00000-of-00001.parquet | Data | 36.9 KB | 14910c6d4de7 |
| college_chemistry/val-00000-of-00001.parquet | Data | 7.9 KB | 7da3751d4784 |
| college_economics/dev-00000-of-00001.parquet | Data | 10.3 KB | ab842afe0b7f |
| college_economics/test-00000-of-00001.parquet | Data | 81.4 KB | 9e81cca6de04 |
| college_economics/val-00000-of-00001.parquet | Data | 15.1 KB | de20bf0e0604 |
| college_physics/dev-00000-of-00001.parquet | Data | 9.8 KB | 0bb90a140fc4 |
| college_physics/test-00000-of-00001.parquet | Data | 43.4 KB | 17ebbf477613 |
| college_physics/val-00000-of-00001.parquet | Data | 9.9 KB | 0e81a35b2dfa |
| college_programming/dev-00000-of-00001.parquet | Data | 8.6 KB | 3aad496c70e7 |
| college_programming/test-00000-of-00001.parquet | Data | 60.9 KB | e5fc86f55e62 |
| college_programming/val-00000-of-00001.parquet | Data | 14.1 KB | 23705408d1e4 |
| computer_architecture/dev-00000-of-00001.parquet | Data | 8.7 KB | 788f847cadd9 |
| computer_architecture/test-00000-of-00001.parquet | Data | 32.2 KB | 4d786875f9a9 |
| computer_architecture/val-00000-of-00001.parquet | Data | 7.9 KB | c1c5fab4950b |
| computer_network/dev-00000-of-00001.parquet | Data | 8.9 KB | db2a85d61052 |
| computer_network/test-00000-of-00001.parquet | Data | 28.5 KB | add0701bdef5 |
| computer_network/val-00000-of-00001.parquet | Data | 7.1 KB | f7dd2a0760c9 |
| discrete_mathematics/dev-00000-of-00001.parquet | Data | 7.1 KB | a1521caa2f35 |
| discrete_mathematics/test-00000-of-00001.parquet | Data | 28.4 KB | af0a3fbd33a8 |
| discrete_mathematics/val-00000-of-00001.parquet | Data | 8.1 KB | 7e04bdff838a |
| education_science/dev-00000-of-00001.parquet | Data | 9.8 KB | 1907cdc9405b |
| education_science/test-00000-of-00001.parquet | Data | 43.1 KB | 94dbb1eccbef |
| education_science/val-00000-of-00001.parquet | Data | 8.8 KB | 6f3a48fc3b60 |
| electrical_engineer/dev-00000-of-00001.parquet | Data | 7.9 KB | 3b353d9f859b |
| electrical_engineer/test-00000-of-00001.parquet | Data | 57.1 KB | 460ed7b2595e |
| electrical_engineer/val-00000-of-00001.parquet | Data | 11.2 KB | cbcca6c3a508 |
| environmental_impact_assessment_engineer/dev-00000-of-00001.parquet | Data | 7.9 KB | 94d8ee2f0eea |
| environmental_impact_assessment_engineer/test-00000-of-00001.parquet | Data | 56.3 KB | 2f1ec9afd3c0 |
| environmental_impact_assessment_engineer/val-00000-of-00001.parquet | Data | 10.5 KB | 73aac8698483 |
| fire_engineer/dev-00000-of-00001.parquet | Data | 7.4 KB | 6cba11088ec4 |
| fire_engineer/test-00000-of-00001.parquet | Data | 60.7 KB | 9ade7267f775 |
| fire_engineer/val-00000-of-00001.parquet | Data | 12.6 KB | a9378038b664 |
| high_school_biology/dev-00000-of-00001.parquet | Data | 7.4 KB | 4332625d5b7d |
| high_school_biology/test-00000-of-00001.parquet | Data | 43.9 KB | 22503cbaff33 |
| high_school_biology/val-00000-of-00001.parquet | Data | 10.0 KB | 2177aa275ad4 |
| high_school_chemistry/dev-00000-of-00001.parquet | Data | 7.3 KB | 791d406f845a |
| high_school_chemistry/test-00000-of-00001.parquet | Data | 39.0 KB | acb8c3689827 |
| high_school_chemistry/val-00000-of-00001.parquet | Data | 9.9 KB | 60d20961edd3 |
| high_school_chinese/dev-00000-of-00001.parquet | Data | 14.7 KB | 620b74b738a7 |
| high_school_chinese/test-00000-of-00001.parquet | Data | 90.7 KB | 208d6e28e600 |
| high_school_chinese/val-00000-of-00001.parquet | Data | 15.6 KB | 1b3cb0cbba73 |
| high_school_geography/dev-00000-of-00001.parquet | Data | 7.9 KB | 3e7fee34cc7d |
| high_school_geography/test-00000-of-00001.parquet | Data | 34.9 KB | bab45b5c483e |
| high_school_geography/val-00000-of-00001.parquet | Data | 7.9 KB | 4bad8dbc6944 |
| high_school_history/dev-00000-of-00001.parquet | Data | 8.8 KB | 926f16013583 |
| high_school_history/test-00000-of-00001.parquet | Data | 48.9 KB | 97bf3996db04 |
| high_school_history/val-00000-of-00001.parquet | Data | 11.0 KB | 67691bf76237 |
| high_school_mathematics/dev-00000-of-00001.parquet | Data | 12.3 KB | 3a8f4c098cc7 |
| high_school_mathematics/test-00000-of-00001.parquet | Data | 31.4 KB | e87e6eb82977 |
| high_school_mathematics/val-00000-of-00001.parquet | Data | 10.0 KB | d0d33970cb39 |
| high_school_physics/dev-00000-of-00001.parquet | Data | 7.7 KB | 4ee020969257 |
| high_school_physics/test-00000-of-00001.parquet | Data | 48.5 KB | 20b10402b1a9 |
| high_school_physics/val-00000-of-00001.parquet | Data | 10.6 KB | 993415a68afb |
| high_school_politics/dev-00000-of-00001.parquet | Data | 13.0 KB | 4af68acf7d4f |
| high_school_politics/test-00000-of-00001.parquet | Data | 63.9 KB | 8fa737389c81 |
| high_school_politics/val-00000-of-00001.parquet | Data | 12.9 KB | ecac3d54c9fd |
| ideological_and_moral_cultivation/dev-00000-of-00001.parquet | Data | 5.6 KB | ffe00a5f10af |
| ideological_and_moral_cultivation/test-00000-of-00001.parquet | Data | 29.9 KB | f8290d4c9851 |
| ideological_and_moral_cultivation/val-00000-of-00001.parquet | Data | 7.5 KB | 464ee51a7c01 |
| law/dev-00000-of-00001.parquet | Data | 10.8 KB | aa946c425664 |
| law/test-00000-of-00001.parquet | Data | 61.2 KB | 91bf9df05a2b |
| law/val-00000-of-00001.parquet | Data | 12.1 KB | bc940e6ca738 |
| legal_professional/dev-00000-of-00001.parquet | Data | 15.2 KB | e3d2fe07b6e8 |
| legal_professional/test-00000-of-00001.parquet | Data | 92.9 KB | 65ff9d1b476a |
| legal_professional/val-00000-of-00001.parquet | Data | 16.5 KB | 07ed092ba4e5 |
| logic/dev-00000-of-00001.parquet | Data | 15.0 KB | 4bcad55d78cf |
| logic/test-00000-of-00001.parquet | Data | 106.5 KB | c8cbd6968a36 |
| logic/val-00000-of-00001.parquet | Data | 19.6 KB | e67297709345 |
| mao_zedong_thought/dev-00000-of-00001.parquet | Data | 9.4 KB | af010d2a53a3 |
| mao_zedong_thought/test-00000-of-00001.parquet | Data | 39.2 KB | 85d790a63f26 |
| mao_zedong_thought/val-00000-of-00001.parquet | Data | 9.3 KB | a1540f6c8692 |
| marxism/dev-00000-of-00001.parquet | Data | 7.1 KB | 477593d35fe7 |
| marxism/test-00000-of-00001.parquet | Data | 30.5 KB | 4b063bf7dba9 |
| marxism/val-00000-of-00001.parquet | Data | 8.0 KB | e1bedacb86e7 |
| metrology_engineer/dev-00000-of-00001.parquet | Data | 8.8 KB | 2fed7f56dd7c |
| metrology_engineer/test-00000-of-00001.parquet | Data | 37.2 KB | 31940a5ecc45 |
| metrology_engineer/val-00000-of-00001.parquet | Data | 9.6 KB | fa22568373b0 |
| middle_school_biology/dev-00000-of-00001.parquet | Data | 10.9 KB | ccfa8a7260f4 |
| middle_school_biology/test-00000-of-00001.parquet | Data | 39.8 KB | 9bf228ba9caf |
| middle_school_biology/val-00000-of-00001.parquet | Data | 9.6 KB | 2d50c9b8702a |
| middle_school_chemistry/dev-00000-of-00001.parquet | Data | 10.5 KB | 57f7eb6200f3 |
| middle_school_chemistry/test-00000-of-00001.parquet | Data | 39.5 KB | a091b1b544d0 |
| middle_school_chemistry/val-00000-of-00001.parquet | Data | 9.2 KB | a34a2b9312b8 |
| middle_school_geography/dev-00000-of-00001.parquet | Data | 8.2 KB | 560fafee90c7 |
| middle_school_geography/test-00000-of-00001.parquet | Data | 22.7 KB | 6e497cf4d274 |
| middle_school_geography/val-00000-of-00001.parquet | Data | 7.2 KB | 655590d36e68 |
| middle_school_history/dev-00000-of-00001.parquet | Data | 6.3 KB | a57d0b7ee192 |
| middle_school_history/test-00000-of-00001.parquet | Data | 40.3 KB | 440ab4d70ece |
| middle_school_history/val-00000-of-00001.parquet | Data | 10.0 KB | 83ba0d7e3d1e |
| middle_school_mathematics/dev-00000-of-00001.parquet | Data | 9.8 KB | a5efc62f0bc6 |
| middle_school_mathematics/test-00000-of-00001.parquet | Data | 27.4 KB | 34151a14afee |
| middle_school_mathematics/val-00000-of-00001.parquet | Data | 9.4 KB | ddd771e85a96 |
| middle_school_physics/dev-00000-of-00001.parquet | Data | 10.3 KB | 236c03f04d55 |
| middle_school_physics/test-00000-of-00001.parquet | Data | 40.7 KB | f8eab15dde69 |
| middle_school_physics/val-00000-of-00001.parquet | Data | 9.8 KB | bd9ee6cfb116 |
| middle_school_politics/dev-00000-of-00001.parquet | Data | 9.5 KB | 8270da43fc57 |
| middle_school_politics/test-00000-of-00001.parquet | Data | 55.4 KB | ee9c650bb167 |
| middle_school_politics/val-00000-of-00001.parquet | Data | 11.3 KB | db974bc6ed17 |
| modern_chinese_history/dev-00000-of-00001.parquet | Data | 10.5 KB | b34f9346bee8 |
| modern_chinese_history/test-00000-of-00001.parquet | Data | 40.3 KB | eb1cbdf6cbd1 |
| modern_chinese_history/val-00000-of-00001.parquet | Data | 8.7 KB | e929497b8491 |
| operating_system/dev-00000-of-00001.parquet | Data | 7.7 KB | 6703adcdfe9f |
| operating_system/test-00000-of-00001.parquet | Data | 25.8 KB | 6eff3679a30a |
| operating_system/val-00000-of-00001.parquet | Data | 7.1 KB | e3b4d7b1d959 |
| physician/dev-00000-of-00001.parquet | Data | 8.6 KB | f3e3dbcd3b90 |
| physician/test-00000-of-00001.parquet | Data | 71.9 KB | b3aefd17ddb4 |
| physician/val-00000-of-00001.parquet | Data | 11.8 KB | edc55a74f63c |
| plant_protection/dev-00000-of-00001.parquet | Data | 9.9 KB | 0740722f4816 |
| plant_protection/test-00000-of-00001.parquet | Data | 26.6 KB | 9a6000a5d83b |
| plant_protection/val-00000-of-00001.parquet | Data | 7.1 KB | 7db8bdf498cf |
| probability_and_statistics/dev-00000-of-00001.parquet | Data | 16.1 KB | 344d84bc6590 |
| probability_and_statistics/test-00000-of-00001.parquet | Data | 38.6 KB | 269538a8921e |
| probability_and_statistics/val-00000-of-00001.parquet | Data | 8.7 KB | f1dccb78d4f9 |
| professional_tour_guide/dev-00000-of-00001.parquet | Data | 7.1 KB | a884f8d1f206 |
| professional_tour_guide/test-00000-of-00001.parquet | Data | 37.3 KB | 111d306190c3 |
| professional_tour_guide/val-00000-of-00001.parquet | Data | 7.9 KB | 20d71b037cee |
| sports_science/dev-00000-of-00001.parquet | Data | 10.8 KB | 68cd9a9efbc2 |
| sports_science/test-00000-of-00001.parquet | Data | 27.7 KB | a830d825b9dd |
| sports_science/val-00000-of-00001.parquet | Data | 7.0 KB | 0c7ef158b247 |
| tax_accountant/dev-00000-of-00001.parquet | Data | 11.5 KB | ee1a74796bd9 |
| tax_accountant/test-00000-of-00001.parquet | Data | 116.7 KB | b1b46763c190 |
| tax_accountant/val-00000-of-00001.parquet | Data | 20.1 KB | ddded210a4dd |
| teacher_qualification/dev-00000-of-00001.parquet | Data | 9.1 KB | 20a5d7254e1a |
| teacher_qualification/test-00000-of-00001.parquet | Data | 82.6 KB | f5453c2ae95e |
| teacher_qualification/val-00000-of-00001.parquet | Data | 14.5 KB | d230bdc88779 |
| urban_and_rural_planner/dev-00000-of-00001.parquet | Data | 8.4 KB | 5b0534b1b87c |
| urban_and_rural_planner/test-00000-of-00001.parquet | Data | 78.2 KB | bbc6981d82d5 |
| urban_and_rural_planner/val-00000-of-00001.parquet | Data | 14.3 KB | 085be7aa2a4e |
| veterinary_medicine/dev-00000-of-00001.parquet | Data | 8.9 KB | fd26a4844b43 |
| veterinary_medicine/test-00000-of-00001.parquet | Data | 32.3 KB | 9ebcf8a3f566 |
| veterinary_medicine/val-00000-of-00001.parquet | Data | 8.0 KB | 96c35c3e0dc9 |
| README.md | Documentation | 40.1 KB | — |
| .gitattributes | Repository | 2.3 KB | — |
License and Download
- License
- cc-by-nc-sa-4.0
- Access
- No access gate
Download from Ceval
Released by Ceval through its official repository on Hugging Face.