Dataset · Visual question answering
PixelProof-Evaluation
by Project PixelProof PixelProof/PixelProof-Evaluation
The frozen evaluation sets for the PixelProof paper. Each eligible replay-verified world contributes exactly five deterministic, pixel-distinct instances.
Dataset Card
The frozen evaluation sets for the PixelProof paper. Each eligible replay-verified world contributes exactly five deterministic, pixel-distinct instances. The five instances of a world share its selected question text while varying the rendered scene and the gold answer, which the world's inverse program recovers from the image alone. The config names, the section column, and the ledgers/section files are holds spatially-steered worlds. The exclusions are the worlds that passed the 200-scene replay (1,301 profile-steered and 875 spatially-steered) but produced fewer than five pixel-distinct scenes; each one is documented in the corresponding ledgers/sectionexclusions.csv file. Each row…
Excerpt from the card by Project PixelProof.
Structure
combined_eval5 10,860 rows
| Split | Rows | Size |
|---|---|---|
| test | 10,860 | 149.7 MB |
section1_eval5 6,490 rows
| Split | Rows | Size |
|---|---|---|
| test | 6,490 | 109.6 MB |
section2_eval5 4,370 rows
| Split | Rows | Size |
|---|---|---|
| test | 4,370 | 40.1 MB |
Details
- Repository
- PixelProof/PixelProof-Evaluation
- Publisher
- Project PixelProof
- Task category
- Visual question answering
- Tags
- synthetic, visual-question-answering, evaluation
- Size category
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- b5d8ea04c365528c7599d091ac64ad1319a4e749
- Last updated
- 2026-09-26
Files
14 files, 161.2 MB in total.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| ledgers/section1_exclusions.csv | Data | 1.0 KB | — |
| ledgers/section1_gold.csv | Data | 2.4 MB | — |
| ledgers/section1_inputs.csv | Data | 6.8 MB | — |
| ledgers/section2_exclusions.csv | Data | 394 B | — |
| ledgers/section2_gold.csv | Data | 1.6 MB | — |
| ledgers/section2_inputs.csv | Data | 4.6 MB | — |
| manifests/mirror-validation.json | Data | 720 B | — |
| manifests/release.json | Data | 796 B | — |
| manifests/source-sections.json | Data | 2.4 KB | — |
| parquet/section1/test-00000.parquet | Data | 107.3 MB | fe7b1eccf36c |
| parquet/section2/test-00000.parquet | Data | 38.6 MB | edb6bd7bfa81 |
| README.md | Documentation | 3.1 KB | — |
| CHECKSUMS.sha256 | Other | 1.2 KB | — |
| .gitattributes | Repository | 2.5 KB | — |
License and Download
- License
- Not stated by the source
- Access
- No access gate
Released by Project PixelProof through its official repository on Hugging Face.