# ceval-exam by Ceval: AI Training Dataset
Source: https://savrn.com/datasets/ceval-exam
Markdown alternate of the page above; the site index is https://savrn.com/llms.txt

---

## Dataset Card

C-Eval is a comprehensive Chinese evaluation suite for foundation models. It consists of 13948 multi-choice questions spanning 52 diverse disciplines and four difficulty levels. Please visit our website and GitHub or check our paper for more details. Each subject consists of three splits: dev, val, and test. The dev set per subject consists of five exemplars with explanations for few-shot evaluation. The val set is intended to be used for hyperparameter tuning. And the test set is for model evaluation. More details on loading and using the data are at our github page. Please cite our paper if you use our dataset.

Excerpt from the card by Ceval, licensed cc-by-nc-sa-4.0.

## Structure

### accountant 497 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 443 | 179.2 KB |
| val | 49 | 19.6 KB |
| dev | 5 | 3.4 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### advanced_mathematics 197 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 173 | 50.9 KB |
| val | 19 | 5.3 KB |
| dev | 5 | 7.0 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### art_studies 336 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 298 | 42.8 KB |
| val | 33 | 4.6 KB |
| dev | 5 | 1.4 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### basic_medicine 199 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 175 | 29.7 KB |
| val | 19 | 2.6 KB |
| dev | 5 | 1.8 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### business_administration 339 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 301 | 79.9 KB |
| val | 33 | 9.2 KB |
| dev | 5 | 3.2 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### chinese_language_and_literature 237 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 209 | 33.4 KB |
| val | 23 | 3.4 KB |
| dev | 5 | 1.9 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### civil_servant 481 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 429 | 183.7 KB |
| val | 47 | 21.3 KB |
| dev | 5 | 4.6 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### clinical_medicine 227 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 200 | 43.2 KB |
| val | 22 | 4.2 KB |
| dev | 5 | 2.0 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### college_chemistry 253 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 224 | 46.9 KB |
| val | 24 | 4.4 KB |
| dev | 5 | 3.6 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### college_economics 557 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 497 | 122.3 KB |
| val | 55 | 14.5 KB |
| dev | 5 | 3.7 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### college_physics 200 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 176 | 56.6 KB |
| val | 19 | 6.1 KB |
| dev | 5 | 3.8 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

### college_programming 384 rows

| Split | Rows | Size |
| --- | --- | --- |
| test | 342 | 85.3 KB |
| val | 37 | 9.5 KB |
| dev | 5 | 2.9 KB |

idint32questionstringAstringBstringCstringDstringanswerstringexplanationstring

## Details

Repository

ceval/ceval-exam

Publisher

Ceval

Task category

Text classification

Tags

Not stated by the source

Size category

10K<n<100K

Languages

zh

Revision

617524a00b307ff6f9933702f724131fe12ca7ce

Last updated

2025-07-27

## SAVRN's Notes on ceval-exam

C-Eval is a Chinese multiple-choice evaluation suite: 3,907 rows across 12 subject configurations, 3.7 MB, 158 files, 159k monthly downloads, task category multiple choice. The card describes 13,948 questions spanning 52 disciplines and four difficulty levels, with each subject carrying dev, val and test splits, where dev holds five exemplars with explanations for few-shot evaluation and val is reserved for hyperparameter tuning.

The license is CC-BY-NC-SA-4.0: non-commercial plus share-alike, which rules it out for most commercial training and tightly constrains anything derived from it. Treat it as an eval for Chinese-capable models, sized so the whole suite fits in any workflow at 3.7 MB across 158 files. Updated as recently as 2025-07-27, so check which release your scores cite, and treat it as eval-only.

SAVRN Research

## Files

158 files, 3.7 MB in total.

Data156 files · 3.7 MB

Documentation1 file · 40.1 KB

Repository1 file · 2.3 KB

Every file

| File | Type | Size | SHA-256 |
| --- | --- | --- | --- |
| accountant/dev-00000-of-00001.parquet | Data | 9.9 KB | 8968397b45ec |
| accountant/test-00000-of-00001.parquet | Data | 120.9 KB | 37e61cdf5bf6 |
| accountant/val-00000-of-00001.parquet | Data | 20.5 KB | f99296e281ce |
| advanced_mathematics/dev-00000-of-00001.parquet | Data | 14.5 KB | 0a59067cde79 |
| advanced_mathematics/test-00000-of-00001.parquet | Data | 29.4 KB | a3758476b616 |
| advanced_mathematics/val-00000-of-00001.parquet | Data | 7.8 KB | e05ed87c1ea5 |
| art_studies/dev-00000-of-00001.parquet | Data | 6.5 KB | 0af5d1f91c37 |
| art_studies/test-00000-of-00001.parquet | Data | 33.4 KB | 17e9479ec724 |
| art_studies/val-00000-of-00001.parquet | Data | 7.5 KB | 8d7f0e954f19 |
| basic_medicine/dev-00000-of-00001.parquet | Data | 7.1 KB | ab699967a442 |
| basic_medicine/test-00000-of-00001.parquet | Data | 25.0 KB | 255dba5d3bfc |
| basic_medicine/val-00000-of-00001.parquet | Data | 6.1 KB | 41395a18f51c |
| business_administration/dev-00000-of-00001.parquet | Data | 10.0 KB | 7aec080858e7 |
| business_administration/test-00000-of-00001.parquet | Data | 54.6 KB | cb452864f24e |
| business_administration/val-00000-of-00001.parquet | Data | 11.8 KB | b897dc81b061 |
| chinese_language_and_literature/dev-00000-of-00001.parquet | Data | 6.6 KB | 2ace6a34b590 |
| chinese_language_and_literature/test-00000-of-00001.parquet | Data | 29.9 KB | 70d7d6f575a2 |
| chinese_language_and_literature/val-00000-of-00001.parquet | Data | 6.6 KB | 50f20440e7a7 |
| civil_servant/dev-00000-of-00001.parquet | Data | 13.1 KB | 3d55ffa82433 |
| civil_servant/test-00000-of-00001.parquet | Data | 145.2 KB | 015630aa00e7 |
| civil_servant/val-00000-of-00001.parquet | Data | 22.4 KB | 7018958b189d |
| clinical_medicine/dev-00000-of-00001.parquet | Data | 6.9 KB | aef59d638d0d |
| clinical_medicine/test-00000-of-00001.parquet | Data | 35.0 KB | 546522335722 |
| clinical_medicine/val-00000-of-00001.parquet | Data | 7.5 KB | c8d691d83dc2 |
| college_chemistry/dev-00000-of-00001.parquet | Data | 9.3 KB | 4b6a5f002562 |
| college_chemistry/test-00000-of-00001.parquet | Data | 36.9 KB | 14910c6d4de7 |
| college_chemistry/val-00000-of-00001.parquet | Data | 7.9 KB | 7da3751d4784 |
| college_economics/dev-00000-of-00001.parquet | Data | 10.3 KB | ab842afe0b7f |
| college_economics/test-00000-of-00001.parquet | Data | 81.4 KB | 9e81cca6de04 |
| college_economics/val-00000-of-00001.parquet | Data | 15.1 KB | de20bf0e0604 |
| college_physics/dev-00000-of-00001.parquet | Data | 9.8 KB | 0bb90a140fc4 |
| college_physics/test-00000-of-00001.parquet | Data | 43.4 KB | 17ebbf477613 |
| college_physics/val-00000-of-00001.parquet | Data | 9.9 KB | 0e81a35b2dfa |
| college_programming/dev-00000-of-00001.parquet | Data | 8.6 KB | 3aad496c70e7 |
| college_programming/test-00000-of-00001.parquet | Data | 60.9 KB | e5fc86f55e62 |
| college_programming/val-00000-of-00001.parquet | Data | 14.1 KB | 23705408d1e4 |
| computer_architecture/dev-00000-of-00001.parquet | Data | 8.7 KB | 788f847cadd9 |
| computer_architecture/test-00000-of-00001.parquet | Data | 32.2 KB | 4d786875f9a9 |
| computer_architecture/val-00000-of-00001.parquet | Data | 7.9 KB | c1c5fab4950b |
| computer_network/dev-00000-of-00001.parquet | Data | 8.9 KB | db2a85d61052 |
| computer_network/test-00000-of-00001.parquet | Data | 28.5 KB | add0701bdef5 |
| computer_network/val-00000-of-00001.parquet | Data | 7.1 KB | f7dd2a0760c9 |
| discrete_mathematics/dev-00000-of-00001.parquet | Data | 7.1 KB | a1521caa2f35 |
| discrete_mathematics/test-00000-of-00001.parquet | Data | 28.4 KB | af0a3fbd33a8 |
| discrete_mathematics/val-00000-of-00001.parquet | Data | 8.1 KB | 7e04bdff838a |
| education_science/dev-00000-of-00001.parquet | Data | 9.8 KB | 1907cdc9405b |
| education_science/test-00000-of-00001.parquet | Data | 43.1 KB | 94dbb1eccbef |
| education_science/val-00000-of-00001.parquet | Data | 8.8 KB | 6f3a48fc3b60 |
| electrical_engineer/dev-00000-of-00001.parquet | Data | 7.9 KB | 3b353d9f859b |
| electrical_engineer/test-00000-of-00001.parquet | Data | 57.1 KB | 460ed7b2595e |
| electrical_engineer/val-00000-of-00001.parquet | Data | 11.2 KB | cbcca6c3a508 |
| environmental_impact_assessment_engineer/dev-00000-of-00001.parquet | Data | 7.9 KB | 94d8ee2f0eea |
| environmental_impact_assessment_engineer/test-00000-of-00001.parquet | Data | 56.3 KB | 2f1ec9afd3c0 |
| environmental_impact_assessment_engineer/val-00000-of-00001.parquet | Data | 10.5 KB | 73aac8698483 |
| fire_engineer/dev-00000-of-00001.parquet | Data | 7.4 KB | 6cba11088ec4 |
| fire_engineer/test-00000-of-00001.parquet | Data | 60.7 KB | 9ade7267f775 |
| fire_engineer/val-00000-of-00001.parquet | Data | 12.6 KB | a9378038b664 |
| high_school_biology/dev-00000-of-00001.parquet | Data | 7.4 KB | 4332625d5b7d |
| high_school_biology/test-00000-of-00001.parquet | Data | 43.9 KB | 22503cbaff33 |
| high_school_biology/val-00000-of-00001.parquet | Data | 10.0 KB | 2177aa275ad4 |
| high_school_chemistry/dev-00000-of-00001.parquet | Data | 7.3 KB | 791d406f845a |
| high_school_chemistry/test-00000-of-00001.parquet | Data | 39.0 KB | acb8c3689827 |
| high_school_chemistry/val-00000-of-00001.parquet | Data | 9.9 KB | 60d20961edd3 |
| high_school_chinese/dev-00000-of-00001.parquet | Data | 14.7 KB | 620b74b738a7 |
| high_school_chinese/test-00000-of-00001.parquet | Data | 90.7 KB | 208d6e28e600 |
| high_school_chinese/val-00000-of-00001.parquet | Data | 15.6 KB | 1b3cb0cbba73 |
| high_school_geography/dev-00000-of-00001.parquet | Data | 7.9 KB | 3e7fee34cc7d |
| high_school_geography/test-00000-of-00001.parquet | Data | 34.9 KB | bab45b5c483e |
| high_school_geography/val-00000-of-00001.parquet | Data | 7.9 KB | 4bad8dbc6944 |
| high_school_history/dev-00000-of-00001.parquet | Data | 8.8 KB | 926f16013583 |
| high_school_history/test-00000-of-00001.parquet | Data | 48.9 KB | 97bf3996db04 |
| high_school_history/val-00000-of-00001.parquet | Data | 11.0 KB | 67691bf76237 |
| high_school_mathematics/dev-00000-of-00001.parquet | Data | 12.3 KB | 3a8f4c098cc7 |
| high_school_mathematics/test-00000-of-00001.parquet | Data | 31.4 KB | e87e6eb82977 |
| high_school_mathematics/val-00000-of-00001.parquet | Data | 10.0 KB | d0d33970cb39 |
| high_school_physics/dev-00000-of-00001.parquet | Data | 7.7 KB | 4ee020969257 |
| high_school_physics/test-00000-of-00001.parquet | Data | 48.5 KB | 20b10402b1a9 |
| high_school_physics/val-00000-of-00001.parquet | Data | 10.6 KB | 993415a68afb |
| high_school_politics/dev-00000-of-00001.parquet | Data | 13.0 KB | 4af68acf7d4f |
| high_school_politics/test-00000-of-00001.parquet | Data | 63.9 KB | 8fa737389c81 |
| high_school_politics/val-00000-of-00001.parquet | Data | 12.9 KB | ecac3d54c9fd |
| ideological_and_moral_cultivation/dev-00000-of-00001.parquet | Data | 5.6 KB | ffe00a5f10af |
| ideological_and_moral_cultivation/test-00000-of-00001.parquet | Data | 29.9 KB | f8290d4c9851 |
| ideological_and_moral_cultivation/val-00000-of-00001.parquet | Data | 7.5 KB | 464ee51a7c01 |
| law/dev-00000-of-00001.parquet | Data | 10.8 KB | aa946c425664 |
| law/test-00000-of-00001.parquet | Data | 61.2 KB | 91bf9df05a2b |
| law/val-00000-of-00001.parquet | Data | 12.1 KB | bc940e6ca738 |
| legal_professional/dev-00000-of-00001.parquet | Data | 15.2 KB | e3d2fe07b6e8 |
| legal_professional/test-00000-of-00001.parquet | Data | 92.9 KB | 65ff9d1b476a |
| legal_professional/val-00000-of-00001.parquet | Data | 16.5 KB | 07ed092ba4e5 |
| logic/dev-00000-of-00001.parquet | Data | 15.0 KB | 4bcad55d78cf |
| logic/test-00000-of-00001.parquet | Data | 106.5 KB | c8cbd6968a36 |
| logic/val-00000-of-00001.parquet | Data | 19.6 KB | e67297709345 |
| mao_zedong_thought/dev-00000-of-00001.parquet | Data | 9.4 KB | af010d2a53a3 |
| mao_zedong_thought/test-00000-of-00001.parquet | Data | 39.2 KB | 85d790a63f26 |
| mao_zedong_thought/val-00000-of-00001.parquet | Data | 9.3 KB | a1540f6c8692 |
| marxism/dev-00000-of-00001.parquet | Data | 7.1 KB | 477593d35fe7 |
| marxism/test-00000-of-00001.parquet | Data | 30.5 KB | 4b063bf7dba9 |
| marxism/val-00000-of-00001.parquet | Data | 8.0 KB | e1bedacb86e7 |
| metrology_engineer/dev-00000-of-00001.parquet | Data | 8.8 KB | 2fed7f56dd7c |
| metrology_engineer/test-00000-of-00001.parquet | Data | 37.2 KB | 31940a5ecc45 |
| metrology_engineer/val-00000-of-00001.parquet | Data | 9.6 KB | fa22568373b0 |
| middle_school_biology/dev-00000-of-00001.parquet | Data | 10.9 KB | ccfa8a7260f4 |
| middle_school_biology/test-00000-of-00001.parquet | Data | 39.8 KB | 9bf228ba9caf |
| middle_school_biology/val-00000-of-00001.parquet | Data | 9.6 KB | 2d50c9b8702a |
| middle_school_chemistry/dev-00000-of-00001.parquet | Data | 10.5 KB | 57f7eb6200f3 |
| middle_school_chemistry/test-00000-of-00001.parquet | Data | 39.5 KB | a091b1b544d0 |
| middle_school_chemistry/val-00000-of-00001.parquet | Data | 9.2 KB | a34a2b9312b8 |
| middle_school_geography/dev-00000-of-00001.parquet | Data | 8.2 KB | 560fafee90c7 |
| middle_school_geography/test-00000-of-00001.parquet | Data | 22.7 KB | 6e497cf4d274 |
| middle_school_geography/val-00000-of-00001.parquet | Data | 7.2 KB | 655590d36e68 |
| middle_school_history/dev-00000-of-00001.parquet | Data | 6.3 KB | a57d0b7ee192 |
| middle_school_history/test-00000-of-00001.parquet | Data | 40.3 KB | 440ab4d70ece |
| middle_school_history/val-00000-of-00001.parquet | Data | 10.0 KB | 83ba0d7e3d1e |
| middle_school_mathematics/dev-00000-of-00001.parquet | Data | 9.8 KB | a5efc62f0bc6 |
| middle_school_mathematics/test-00000-of-00001.parquet | Data | 27.4 KB | 34151a14afee |
| middle_school_mathematics/val-00000-of-00001.parquet | Data | 9.4 KB | ddd771e85a96 |
| middle_school_physics/dev-00000-of-00001.parquet | Data | 10.3 KB | 236c03f04d55 |
| middle_school_physics/test-00000-of-00001.parquet | Data | 40.7 KB | f8eab15dde69 |
| middle_school_physics/val-00000-of-00001.parquet | Data | 9.8 KB | bd9ee6cfb116 |
| middle_school_politics/dev-00000-of-00001.parquet | Data | 9.5 KB | 8270da43fc57 |
| middle_school_politics/test-00000-of-00001.parquet | Data | 55.4 KB | ee9c650bb167 |
| middle_school_politics/val-00000-of-00001.parquet | Data | 11.3 KB | db974bc6ed17 |
| modern_chinese_history/dev-00000-of-00001.parquet | Data | 10.5 KB | b34f9346bee8 |
| modern_chinese_history/test-00000-of-00001.parquet | Data | 40.3 KB | eb1cbdf6cbd1 |
| modern_chinese_history/val-00000-of-00001.parquet | Data | 8.7 KB | e929497b8491 |
| operating_system/dev-00000-of-00001.parquet | Data | 7.7 KB | 6703adcdfe9f |
| operating_system/test-00000-of-00001.parquet | Data | 25.8 KB | 6eff3679a30a |
| operating_system/val-00000-of-00001.parquet | Data | 7.1 KB | e3b4d7b1d959 |
| physician/dev-00000-of-00001.parquet | Data | 8.6 KB | f3e3dbcd3b90 |
| physician/test-00000-of-00001.parquet | Data | 71.9 KB | b3aefd17ddb4 |
| physician/val-00000-of-00001.parquet | Data | 11.8 KB | edc55a74f63c |
| plant_protection/dev-00000-of-00001.parquet | Data | 9.9 KB | 0740722f4816 |
| plant_protection/test-00000-of-00001.parquet | Data | 26.6 KB | 9a6000a5d83b |
| plant_protection/val-00000-of-00001.parquet | Data | 7.1 KB | 7db8bdf498cf |
| probability_and_statistics/dev-00000-of-00001.parquet | Data | 16.1 KB | 344d84bc6590 |
| probability_and_statistics/test-00000-of-00001.parquet | Data | 38.6 KB | 269538a8921e |
| probability_and_statistics/val-00000-of-00001.parquet | Data | 8.7 KB | f1dccb78d4f9 |
| professional_tour_guide/dev-00000-of-00001.parquet | Data | 7.1 KB | a884f8d1f206 |
| professional_tour_guide/test-00000-of-00001.parquet | Data | 37.3 KB | 111d306190c3 |
| professional_tour_guide/val-00000-of-00001.parquet | Data | 7.9 KB | 20d71b037cee |
| sports_science/dev-00000-of-00001.parquet | Data | 10.8 KB | 68cd9a9efbc2 |
| sports_science/test-00000-of-00001.parquet | Data | 27.7 KB | a830d825b9dd |
| sports_science/val-00000-of-00001.parquet | Data | 7.0 KB | 0c7ef158b247 |
| tax_accountant/dev-00000-of-00001.parquet | Data | 11.5 KB | ee1a74796bd9 |
| tax_accountant/test-00000-of-00001.parquet | Data | 116.7 KB | b1b46763c190 |
| tax_accountant/val-00000-of-00001.parquet | Data | 20.1 KB | ddded210a4dd |
| teacher_qualification/dev-00000-of-00001.parquet | Data | 9.1 KB | 20a5d7254e1a |
| teacher_qualification/test-00000-of-00001.parquet | Data | 82.6 KB | f5453c2ae95e |
| teacher_qualification/val-00000-of-00001.parquet | Data | 14.5 KB | d230bdc88779 |
| urban_and_rural_planner/dev-00000-of-00001.parquet | Data | 8.4 KB | 5b0534b1b87c |
| urban_and_rural_planner/test-00000-of-00001.parquet | Data | 78.2 KB | bbc6981d82d5 |
| urban_and_rural_planner/val-00000-of-00001.parquet | Data | 14.3 KB | 085be7aa2a4e |
| veterinary_medicine/dev-00000-of-00001.parquet | Data | 8.9 KB | fd26a4844b43 |
| veterinary_medicine/test-00000-of-00001.parquet | Data | 32.3 KB | 9ebcf8a3f566 |
| veterinary_medicine/val-00000-of-00001.parquet | Data | 8.0 KB | 96c35c3e0dc9 |
| README.md | Documentation | 40.1 KB | — |
| .gitattributes | Repository | 2.3 KB | — |

## License and Download

License

cc-by-nc-sa-4.0

Access

No access gate

[Download from Ceval](https://huggingface.co/datasets/ceval/ceval-exam)

Released by Ceval through its official repository on Hugging Face.

## Ceval

[All models and datasets](https://savrn.com/model-publishers/ceval)

## Explore More

- [The dataset directory](https://savrn.com/datasets)
- [The model directory](https://savrn.com/models)
- [Research papers](https://savrn.com/papers)

## Source

- Repository metadata, read 2026-10-19.
- [Hugging Face record](https://huggingface.co/datasets/ceval/ceval-exam)
- [How the hub is built](https://savrn.com/model-hub/methodology)
