TRACE-OU-Bench is a sequential benchmark for ontology-update decisions under evolving ontology states. It contains 620 human-reviewed ontology-update proposals generated from public U.S. SEC 10-Q filings covering 45 U.S.
Dataset Card
TRACE-OU-Bench is a sequential benchmark for ontology-update decisions under evolving ontology states. It contains 620 human-reviewed ontology-update proposals generated from public U.S. SEC 10-Q filings covering 45 U.S. companies, five sectors, and 2016–2026. The public release does not redistribute SEC filing text. Instead, each record retains SEC provenance, deterministic chunk identifiers, offsets, and SHA-256 hashes. reconstruction/traceoureconstructv11.py downloads the original filing from SEC EDGAR and deterministically reconstructs the source chunk. - Train (2016–2023): 350 proposals generated against O0; reviewed Train updates build O1. - Test (2025–2026): 150 proposals generated…
Excerpt from the card by TRACE-OU.
Structure
default 620 rows
| Split | Rows | Size |
|---|---|---|
| train | 350 | 2.5 MB |
| calibration | 120 | 3.0 MB |
| test | 150 | 3.8 MB |
prefilter_audit 250 rows
| Split | Rows | Size |
|---|---|---|
| train | 100 | 622.9 KB |
| calibration | 75 | 1.8 MB |
| test | 75 | 1.8 MB |
Details
- Repository
- TRACE-OU/TRACE-OU-Bench
- Publisher
- TRACE-OU
- Task category
- Text classification
- Tags
- knowledge-graph, ontology, ontology-evolution
- Size category
- n<1K
- Languages
- en
- Revision
- 1ae1dbaa2aab85205c80e12904e27210157c8682
- Last updated
- 2026-10-06
Files
38 files, 15.1 MB in total.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| SHA256SUMS.txt | Data | 3.6 KB | — |
| audit/calibration_prefilter_audit.csv | Data | 2.0 MB | — |
| audit/test_prefilter_audit.csv | Data | 2.0 MB | — |
| audit/train_prefilter_audit.csv | Data | 672.5 KB | — |
| data/calibration.csv | Data | 3.3 MB | — |
| data/test.csv | Data | 4.1 MB | — |
| data/train.csv | Data | 2.6 MB | — |
| ontology/O0_relation_inventory.txt | Data | 1.5 KB | — |
| ontology/O0_relations.json | Data | 4.9 KB | — |
| ontology/O0_seed_ontology.json | Data | 14.4 KB | — |
| ontology/O1_relation_inventory.txt | Data | 6.9 KB | — |
| ontology/O1_relations.json | Data | 19.7 KB | — |
| ontology/O2_relation_inventory.txt | Data | 6.9 KB | — |
| ontology/O2_relations.json | Data | 19.9 KB | — |
| ontology/snapshot_manifest.json | Data | 1.2 KB | — |
| publishing/viewer_configuration_validation.json | Data | 508 B | — |
| reconstruction/full_reconstruction_validation.json | Data | 8.0 KB | — |
| reconstruction/parser_compatibility_validation.json | Data | 8.1 KB | — |
| reconstruction/reconstruction_fix_validation.json | Data | 1.4 KB | — |
| reconstruction/release_chunk_manifest.csv | Data | 243.1 KB | — |
| reconstruction/requirements.txt | Data | 76 B | — |
| reliability/blinded_repeat_mapping.csv | Data | 6.8 KB | — |
| DATA_DICTIONARY.md | Documentation | 8.5 KB | — |
| README.md | Documentation | 14.3 KB | — |
| SOURCE_RECONSTRUCTION_NOTICE.md | Documentation | 389 B | — |
| SOURCE_TEXT_MIGRATION_REPORT.md | Documentation | 1.5 KB | — |
| VALIDATION.md | Documentation | 5.0 KB | — |
| publishing/HUGGINGFACE_UPDATE_ZH.md | Documentation | 5.2 KB | — |
| reconstruction/CANONICAL_SPEC.md | Documentation | 3.6 KB | — |
| reconstruction/FULL_VALIDATION_ZH.md | Documentation | 3.9 KB | — |
| reconstruction/PARSER_VERSION_FIX_ZH.md | Documentation | 3.3 KB | — |
| reconstruction/README_RECONSTRUCTION.md | Documentation | 6.6 KB | — |
| reconstruction/RECONSTRUCTION_FIX_ZH.md | Documentation | 2.8 KB | — |
| publishing/upload_hf_release.py | Other | 5.2 KB | — |
| reconstruction/test_reconstruction.py | Other | 11.5 KB | — |
| reconstruction/trace_ou_reconstruct_v11.py | Other | 27.8 KB | — |
| reconstruction/validate_reconstructed_release.py | Other | 12.4 KB | — |
| .gitattributes | Repository | 2.5 KB | — |
License and Download
- License
- Not stated by the source
- Access
- No access gate
Released by TRACE-OU through its official repository on Hugging Face.