Skip to page content
SAVRN
Search Plan a project

Dataset · Other

OPERATE-Benchmark

by Huanxuan Liao Xnhyacinth/OPERATE-Benchmark

The parent v0.61 admission ledger records 2,476 terminal candidate decisions with zero unresolved.

Rows—
Configurations—
Size271.6 MB
Licenseother
AccessPublicly accessible
Monthly Downloads59

Dataset Card

The parent v0.61 admission ledger records 2,476 terminal candidate decisions with zero unresolved. v0.62 introduces zero newly mined candidates; it preserves that historical lineage while qualifying corrected contracts for the same 769-row, 502-source denominator. Historical admission evidence is not relabelled as newly executed evidence. Benchmarking Persistent Operational Agency in Source-Grounded Executable Systems This private dataset distributes the manifest-backed artifacts for the active operatev0620 release in Xnhyacinth/OPERATE-Benchmark, retaining private maintenance history. The public current distribution is Xnhyacinth/OPERATE. The promoted Core contains 769 scenarios grounded…

Excerpt from the card by Huanxuan Liao, licensed other.

Details

Repository
Xnhyacinth/OPERATE-Benchmark
Publisher
Huanxuan Liao
Task category
Other
Tags
benchmark, llm-agents, agentic-evaluation
Size category
Not stated by the source
Languages
llm-agents
Revision
701e5896e8119add24ad5efc6de57430f8f132a8
Last updated
2026-10-03

Files

8 files, 271.6 MB in total.

Data6 files · 271.6 MB
Documentation1 file · 5.2 KB
Repository1 file · 2.5 KB
Every file
FileTypeSizeSHA-256
MANIFEST.jsonData1.4 MB—
backend_runtime_closure.jsonData461.3 KB—
candidate_closure.jsonData1.8 KB—
operate_v0_62_0_backends.tar.zstData269.2 MB4da05edddf6d
operate_v0_62_0_formal_evidence.tar.zstData457.3 KBec6547fc76e9
release_manifest.jsonData31.2 KB—
README.mdDocumentation5.2 KB—
.gitattributesRepository2.5 KB—

License and Download

License
other
Access
No access gate
Download from Huanxuan Liao

Released by Huanxuan Liao through its official repository on Hugging Face.