This repository hosts the Parquet edition of VL-CheckList (EMNLP 2022). - imageshake2019: Sharded image pool containing binary image bytes. - relation, location, size: Evaluation test cases with POS/NEG prompt pairs.
Rows484,984
Configurations9
Size14.0 GB
Licensecc-by-4.0
AccessPublicly accessible
Monthly Downloads—
Dataset Card
By Tri Lai, published under cc-by-4.0, revision f8e118b559b4.
VL-CheckList Benchmark (Hugging Face Edition)
This repository hosts the Parquet edition of VL-CheckList (EMNLP 2022). - Official GitHub: https://github.com/om-ai-lab/VL-CheckList - Paper: https://arxiv.org/abs/2207.00221
Available Subsets:
images_hake_2019: Sharded image pool containing binary image bytes.relation_*,location_*,size_*: Evaluation test cases with POS/NEG prompt pairs.
Structure
images_hake_2019 29,113 rows
| Split | Rows | Size |
|---|---|---|
| test | 29,113 | 7.5 GB |
imageImageimage_idstringimage_pathstring
images_openimages 20,140 rows
| Split | Rows | Size |
|---|---|---|
| test | 20,140 | 6.3 GB |
imageImageimage_idstringimage_pathstring
location_hake_obj_center 101,228 rows
| Split | Rows | Size |
|---|---|---|
| test | 101,228 | 8.1 MB |
image_idstringimage_pathstringpos_itemlistneg_itemlist
location_hake_obj_margin 7,717 rows
| Split | Rows | Size |
|---|---|---|
| test | 7,717 | 583.0 KB |
image_idstringimage_pathstringpos_itemlistneg_itemlist
location_hake_obj_mid 61,497 rows
| Split | Rows | Size |
|---|---|---|
| test | 61,497 | 4.7 MB |
image_idstringimage_pathstringpos_itemlistneg_itemlist
relation_hake_action 153,008 rows
| Split | Rows | Size |
|---|---|---|
| test | 153,008 | 15.0 MB |
image_idstringimage_pathstringpos_itemlistneg_itemlist
size_hake_obj_large 93,402 rows
| Split | Rows | Size |
|---|---|---|
| test | 93,402 | 8.2 MB |
image_idstringimage_pathstringpos_itemlistneg_itemlist
size_hake_obj_medium 16,719 rows
| Split | Rows | Size |
|---|---|---|
| test | 16,719 | 1.7 MB |
image_idstringimage_pathstringpos_itemlistneg_itemlist
size_hake_obj_small 2,160 rows
| Split | Rows | Size |
|---|---|---|
| test | 2,160 | 232.8 KB |
image_idstringimage_pathstringpos_itemlistneg_itemlist
Details
- Repository
- w4nn4b3M4ST3R/vl-checklist
- Publisher
- Tri Lai
- Task category
- Visual question answering
- Tags
- vision-language, benchmark, vl-checklist
- Size category
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- f8e118b559b45632db15f2f28db54ec25a9a7e0a
- Last updated
- 2026-10-01
Files
81 files, 14.0 GB in total.
Data79 files · 14.0 GB
Documentation1 file · 1.4 KB
Repository1 file · 2.8 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| data/images_hake_2019/test-00000-of-00003.parquet | Data | 2.7 GB | dbfd852dbdfe |
| data/images_hake_2019/test-00001-of-00003.parquet | Data | 2.4 GB | 823e0753e1ae |
| data/images_hake_2019/test-00002-of-00003.parquet | Data | 2.4 GB | 7aba5b10cc90 |
| data/images_openimages/test-00000-of-00003.parquet | Data | 3.1 GB | f18444dfdcf1 |
| data/images_openimages/test-00001-of-00003.parquet | Data | 3.1 GB | c5c4fd69fb61 |
| data/images_openimages/test-00002-of-00003.parquet | Data | 48.5 MB | 39a52d85af94 |
| data/location_hake_obj_center/test-hake2019.parquet | Data | 2.2 MB | 72bd01d2dbcc |
| data/location_hake_obj_center/test-openimages.parquet | Data | 870.4 KB | 6684296e5ba5 |
| data/location_hake_obj_margin/test-hake2019.parquet | Data | 148.8 KB | d8f0356e97c8 |
| data/location_hake_obj_margin/test-openimages.parquet | Data | 126.6 KB | 1e381ed91a63 |
| data/location_hake_obj_mid/test-hake2019.parquet | Data | 1.3 MB | ea4be45118d1 |
| data/location_hake_obj_mid/test-openimages.parquet | Data | 824.3 KB | f010da7e763b |
| data/relation_hake_action/test-hake2019.parquet | Data | 2.9 MB | c90eff822c70 |
| data/relation_hake_action/test-openimages.parquet | Data | 2.7 MB | cb9505148691 |
| data/size_hake_obj_large/test-hake2019.parquet | Data | 2.2 MB | a936a40b16d3 |
| data/size_hake_obj_large/test-openimages.parquet | Data | 1.2 MB | 71005ce40cd8 |
| data/size_hake_obj_medium/test-hake2019.parquet | Data | 295.3 KB | 2e0d3bfb597d |
| data/size_hake_obj_medium/test-openimages.parquet | Data | 86.2 KB | 74a8cdbad64b |
| data/size_hake_obj_small/test-hake2019.parquet | Data | 20.9 KB | 8cc37a23f541 |
| data/size_hake_obj_small/test-openimages.parquet | Data | 7.2 KB | 174955848b04 |
| raw_annotations/Attribute/vaw/action.json | Data | 247.2 KB | — |
| raw_annotations/Attribute/vaw/color.json | Data | 5.1 MB | — |
| raw_annotations/Attribute/vaw/material.json | Data | 941.5 KB | — |
| raw_annotations/Attribute/vaw/size.json | Data | 1.2 MB | — |
| raw_annotations/Attribute/vaw/state.json | Data | 381.2 KB | — |
| raw_annotations/Attribute/vg/action.json | Data | 176.0 KB | — |
| raw_annotations/Attribute/vg/color.json | Data | 1.0 MB | — |
| raw_annotations/Attribute/vg/material.json | Data | 226.9 KB | — |
| raw_annotations/Attribute/vg/size.json | Data | 239.1 KB | — |
| raw_annotations/Attribute/vg/state.json | Data | 84.9 KB | — |
| raw_annotations/Object/Location/hake_location/hake_obj_center.json | Data | 14.4 MB | 453fb21656d6 |
| raw_annotations/Object/Location/hake_location/hake_obj_margin.json | Data | 1.2 MB | — |
| raw_annotations/Object/Location/hake_location/hake_obj_mid.json | Data | 9.2 MB | — |
| raw_annotations/Object/Location/swig_location/swig_agent/swig_agent_center.json | Data | 6.5 MB | — |
| raw_annotations/Object/Location/swig_location/swig_agent/swig_agent_margin.json | Data | 104.0 KB | — |
| raw_annotations/Object/Location/swig_location/swig_agent/swig_agent_mid.json | Data | 2.0 MB | — |
| raw_annotations/Object/Location/swig_location/swig_destination/swig_destination_center.json | Data | 493.1 KB | — |
| raw_annotations/Object/Location/swig_location/swig_destination/swig_destination_margin.json | Data | 23.7 KB | — |
| raw_annotations/Object/Location/swig_location/swig_destination/swig_destination_mid.json | Data | 254.3 KB | — |
| raw_annotations/Object/Location/swig_location/swig_item/swig_item_center.json | Data | 1.7 MB | — |
| raw_annotations/Object/Location/swig_location/swig_item/swig_item_margin.json | Data | 37.5 KB | — |
| raw_annotations/Object/Location/swig_location/swig_item/swig_item_mid.json | Data | 695.2 KB | — |
| raw_annotations/Object/Location/swig_location/swig_tool/swig_tool_center.json | Data | 1.8 MB | — |
| raw_annotations/Object/Location/swig_location/swig_tool/swig_tool_margin.json | Data | 56.8 KB | — |
| raw_annotations/Object/Location/swig_location/swig_tool/swig_tool_mid.json | Data | 1.0 MB | — |
| raw_annotations/Object/Location/vg_location/vg_obj_center.json | Data | 5.0 MB | — |
| raw_annotations/Object/Location/vg_location/vg_obj_margin.json | Data | 719.7 KB | — |
| raw_annotations/Object/Location/vg_location/vg_obj_mid.json | Data | 4.2 MB | — |
| raw_annotations/Object/Location/vg_location/vg_subj_center.json | Data | 2.4 MB | — |
| raw_annotations/Object/Location/vg_location/vg_subj_margin.json | Data | 551.6 KB | — |
| raw_annotations/Object/Location/vg_location/vg_subj_mid.json | Data | 2.4 MB | — |
| raw_annotations/Object/Size/hake_size/hake_obj_large.json | Data | 12.5 MB | ead71a6997bf |
| raw_annotations/Object/Size/hake_size/hake_obj_medium.json | Data | 3.5 MB | — |
| raw_annotations/Object/Size/hake_size/hake_obj_small.json | Data | 674.0 KB | — |
| raw_annotations/Object/Size/swig_size/swig_agent/swig_agent_large.json | Data | 8.4 MB | — |
| raw_annotations/Object/Size/swig_size/swig_agent/swig_agent_medium.json | Data | 170.2 KB | — |
| raw_annotations/Object/Size/swig_size/swig_agent/swig_agent_small.json | Data | 17.7 KB | — |
| raw_annotations/Object/Size/swig_size/swig_destination/swig_destination_large.json | Data | 714.8 KB | — |
| raw_annotations/Object/Size/swig_size/swig_destination/swig_destination_medium.json | Data | 52.0 KB | — |
| raw_annotations/Object/Size/swig_size/swig_destination/swig_destination_small.json | Data | 4.3 KB | — |
| raw_annotations/Object/Size/swig_size/swig_item/swig_item_large.json | Data | 2.0 MB | — |
| raw_annotations/Object/Size/swig_size/swig_item/swig_item_medium.json | Data | 304.5 KB | — |
| raw_annotations/Object/Size/swig_size/swig_item/swig_item_small.json | Data | 64.4 KB | — |
| raw_annotations/Object/Size/swig_size/swig_place/swig_place_large.json | Data | 2 B | — |
| raw_annotations/Object/Size/swig_size/swig_place/swig_place_medium.json | Data | 2 B | — |
| raw_annotations/Object/Size/swig_size/swig_place/swig_place_small.json | Data | 2 B | — |
| raw_annotations/Object/Size/swig_size/swig_tool/swig_tool_large.json | Data | 2.1 MB | — |
| raw_annotations/Object/Size/swig_size/swig_tool/swig_tool_medium.json | Data | 652.6 KB | — |
| raw_annotations/Object/Size/swig_size/swig_tool/swig_tool_small.json | Data | 135.5 KB | — |
| raw_annotations/Object/Size/vg_size/vg_obj_large.json | Data | 6.1 MB | — |
| raw_annotations/Object/Size/vg_size/vg_obj_medium.json | Data | 2.7 MB | — |
| raw_annotations/Object/Size/vg_size/vg_obj_small.json | Data | 1.2 MB | — |
| raw_annotations/Object/Size/vg_size/vg_subj_large.json | Data | 2.4 MB | — |
| raw_annotations/Object/Size/vg_size/vg_subj_medium.json | Data | 1.9 MB | — |
| raw_annotations/Object/Size/vg_size/vg_subj_small.json | Data | 961.4 KB | — |
| raw_annotations/Relation/hake_action.json | Data | 36.5 MB | 6d9c0ca595d6 |
| raw_annotations/Relation/swig_action.json | Data | 3.9 MB | — |
| raw_annotations/Relation/vg/action.json | Data | 1.2 MB | — |
| raw_annotations/Relation/vg/spatial.json | Data | 2.8 MB | — |
| README.md | Documentation | 1.4 KB | — |
| .gitattributes | Repository | 2.8 KB | — |
License and Download
- License
- cc-by-4.0
- Access
- No access gate
Download from Tri Lai
Released by Tri Lai through its official repository on Hugging Face. Read the license.