Skip to page content
SAVRN
Search Plan a project

Dataset

winogrande

by Ai2 allenai/winogrande

WinoGrande is a new collection of 44k problems, inspired by Winograd Schema Challenge (Levesque, Davis, and Morgenstern 2011), but adjusted to improve the scale and robustness against the dataset-specific bias.

Rows81,442
Configurations6
Size4.6 MB
License—
AccessPublicly accessible
Monthly Downloads404.4k

Dataset Card

WinoGrande is a new collection of 44k problems, inspired by Winograd Schema Challenge (Levesque, Davis, and Morgenstern 2011), but adjusted to improve the scale and robustness against the dataset-specific bias. Formulated as a fill-in-a-blank task with binary options, the goal is to choose the right option for a given sentence which requires commonsense reasoning. An example of 'train' looks as follows. An example of 'validation' looks as follows. An example of 'validation' looks as follows. An example of 'validation' looks as follows. An example of 'train' looks as follows. The data fields are the same among all splits. - sentence: a string feature. - option1: a string feature. - option2…

Excerpt from the card by Ai2.

Structure

winogrande_debiased 12,282 rows

SplitRowsSize
train9,2481.1 MB
test1,767204.5 KB
validation1,267147.4 KB
sentencestringoption1stringoption2stringanswerstring

winogrande_l 13,268 rows

SplitRowsSize
train10,2341.2 MB
test1,767204.5 KB
validation1,267147.4 KB
sentencestringoption1stringoption2stringanswerstring

winogrande_m 5,592 rows

SplitRowsSize
train2,558289.4 KB
test1,767204.5 KB
validation1,267147.4 KB
sentencestringoption1stringoption2stringanswerstring

winogrande_s 3,674 rows

SplitRowsSize
train64072.6 KB
test1,767204.5 KB
validation1,267147.4 KB
sentencestringoption1stringoption2stringanswerstring

winogrande_xl 43,432 rows

SplitRowsSize
train40,3984.5 MB
test1,767204.5 KB
validation1,267147.4 KB
sentencestringoption1stringoption2stringanswerstring

winogrande_xs 3,194 rows

SplitRowsSize
train16019.0 KB
test1,767204.5 KB
validation1,267147.4 KB
sentencestringoption1stringoption2stringanswerstring

Details

Repository
allenai/winogrande
Publisher
Ai2
Task category
Not stated by the source
Tags
Not stated by the source
Size category
Not stated by the source
Languages
en
Revision
01e74176c63542e6b0bcb004dcdea22d94fb67b5
Last updated
2025-07-11

SAVRN's Notes on winogrande

WinoGrande is Ai2's scaled-up Winograd challenge: 81,442 rows across six configurations — xs 3,194 up to xl 43,432, plus the 12,282-row debiased set — in 4.6 MB and 20 files, downloaded 404.4k times a month. Each problem is a fill-in-the-blank sentence with two candidate answers that demands commonsense resolution. The card calls it a collection of 44k problems adjusted for scale and robustness against dataset-specific bias, so treat the sizes as sampling tiers of one design.

It is benchmark material: train on the official train splits, never on validation, and expect any published number to be compared against a paper trail going back years. The debiased configuration is the split to trust if you fine-tune, precisely because the card flags bias-robustness as the design goal. One real gap: the license field reads 'Not stated by the source' on this record, so a commercial training run needs terms confirmed with Ai2 before weights ship.

SAVRN Research

Files

20 files, 4.6 MB in total.

Data18 files · 4.6 MB
Documentation1 file · 11.2 KB
Repository1 file · 1.2 KB
Every file
FileTypeSizeSHA-256
winogrande_debiased/test-00000-of-00001.parquetData117.7 KB100885ec03a6
winogrande_debiased/train-00000-of-00001.parquetData616.8 KBb69a6e9c13a6
winogrande_debiased/validation-00000-of-00001.parquetData85.9 KBf9d914d1818c
winogrande_l/test-00000-of-00001.parquetData117.7 KB100885ec03a6
winogrande_l/train-00000-of-00001.parquetData529.5 KBd6f5c0c5d288
winogrande_l/validation-00000-of-00001.parquetData85.9 KBf9d914d1818c
winogrande_m/test-00000-of-00001.parquetData117.7 KB100885ec03a6
winogrande_m/train-00000-of-00001.parquetData133.8 KBa3be4246db58
winogrande_m/validation-00000-of-00001.parquetData85.9 KBf9d914d1818c
winogrande_s/test-00000-of-00001.parquetData117.7 KB100885ec03a6
winogrande_s/train-00000-of-00001.parquetData34.8 KBce089cd597b8
winogrande_s/validation-00000-of-00001.parquetData85.9 KBf9d914d1818c
winogrande_xl/test-00000-of-00001.parquetData117.7 KB100885ec03a6
winogrande_xl/train-00000-of-00001.parquetData2.1 MB5d8c38ad12b9
winogrande_xl/validation-00000-of-00001.parquetData85.9 KBf9d914d1818c
winogrande_xs/test-00000-of-00001.parquetData117.7 KB100885ec03a6
winogrande_xs/train-00000-of-00001.parquetData11.7 KBa4698ccae8c0
winogrande_xs/validation-00000-of-00001.parquetData85.9 KBf9d914d1818c
README.mdDocumentation11.2 KB—
.gitattributesRepository1.2 KB—

License and Download

License
Not stated by the source
Access
No access gate
Download from Ai2

Released by Ai2 through its official repository on Hugging Face.

Models Trained on This Dataset