SAVRN
Search Contact SAVRN

Dataset · Text classification

glue

by NYU Machine Learning for Language nyu-mll/glue

GLUE, the General Language Understanding Evaluation benchmark (https://gluebenchmark.com/) is a collection of resources for training, evaluating, and analyzing natural language understanding systems.

Rows1,485,043
Configurations12
Size162.3 MB
Licenseother
AccessPublicly accessible
Monthly Downloads850k

Dataset Card

GLUE, the General Language Understanding Evaluation benchmark (https://gluebenchmark.com/) is a collection of resources for training, evaluating, and analyzing natural language understanding systems. The leaderboard for the GLUE benchmark can be found at this address. It comprises the following tasks: A manually-curated evaluation dataset for fine-grained analysis of system performance on a broad range of linguistic phenomena. This dataset evaluates sentence understanding through Natural Language Inference (NLI) problems. Use a model trained on MulitNLI to produce predictions for this dataset. The Corpus of Linguistic Acceptability consists of English acceptability judgments drawn from…

Excerpt from the card by NYU Machine Learning for Language, licensed other.

Structure

ax 1,104 rows

SplitRowsSize
test1,104243.8 KB
premisestringhypothesisstringlabelClassLabelidxint32

cola 10,657 rows

SplitRowsSize
train8,551522.3 KB
validation1,04360.8 KB
test1,06361.0 KB
sentencestringlabelClassLabelidxint32

mnli 431,992 rows

SplitRowsSize
train392,70275.5 MB
validation_matched9,8151.8 MB
validation_mismatched9,8321.9 MB
test_matched9,7961.9 MB
test_mismatched9,8472.0 MB
premisestringhypothesisstringlabelClassLabelidxint32

mnli_matched 19,611 rows

SplitRowsSize
validation9,8151.8 MB
test9,7961.9 MB
premisestringhypothesisstringlabelClassLabelidxint32

mnli_mismatched 19,679 rows

SplitRowsSize
validation9,8321.9 MB
test9,8472.0 MB
premisestringhypothesisstringlabelClassLabelidxint32

mrpc 5,801 rows

SplitRowsSize
train3,668940.4 KB
validation408106.0 KB
test1,725442.3 KB
sentence1stringsentence2stringlabelClassLabelidxint32

qnli 115,669 rows

SplitRowsSize
train104,74325.4 MB
validation5,4631.4 MB
test5,4631.4 MB
questionstringsentencestringlabelClassLabelidxint32

qqp 795,241 rows

SplitRowsSize
train363,84651.6 MB
validation40,4305.7 MB
test390,96555.1 MB
question1stringquestion2stringlabelClassLabelidxint32

rte 5,767 rows

SplitRowsSize
train2,490857.1 KB
validation27790.8 KB
test3,000724.5 KB
sentence1stringsentence2stringlabelClassLabelidxint32

sst2 70,042 rows

SplitRowsSize
train67,3494.7 MB
validation872106.5 KB
test1,821218.3 KB
sentencestringlabelClassLabelidxint32

stsb 8,628 rows

SplitRowsSize
train5,749458.1 KB
validation1,500195.8 KB
test1,379156.8 KB
sentence1stringsentence2stringlabelfloat32idxint32

wnli 852 rows

SplitRowsSize
train635107.3 KB
validation7112.2 KB
test14637.9 KB
sentence1stringsentence2stringlabelClassLabelidxint32

Details

Repository
nyu-mll/glue
Publisher
NYU Machine Learning for Language
Task category
Text classification
Tags
qa-nli, coreference-nli, paraphrase-identification
Size category
10K<n<100K
Languages
en
Revision
bcdcba79d07bc864c1c254ccfcedcce55bcc9a8c
Last updated
2024-01-30

Files

36 files, 162.3 MB in total.

Data34 files · 162.2 MB
Documentation1 file · 35.3 KB
Repository1 file · 1.2 KB
Every file
FileTypeSizeSHA-256
ax/test-00000-of-00001.parquetData80.8 KBa07b802fe2d4
cola/test-00000-of-00001.parquetData37.7 KB3c4d526b6f49
cola/train-00000-of-00001.parquetData251.1 KB2e7538afa200
cola/validation-00000-of-00001.parquetData37.6 KBc14b7219a7d9
mnli/test_matched-00000-of-00001.parquetData1.2 MBa330c4f2aeb0
mnli/test_mismatched-00000-of-00001.parquetData1.3 MBe5078398d5c8
mnli/train-00000-of-00001.parquetData52.2 MB49a4a5508b89
mnli/validation_matched-00000-of-00001.parquetData1.2 MB7f918c09d9c3
mnli/validation_mismatched-00000-of-00001.parquetData1.3 MB04aba92823a9
mnli_matched/test-00000-of-00001.parquetData1.2 MBa330c4f2aeb0
mnli_matched/validation-00000-of-00001.parquetData1.2 MB7f918c09d9c3
mnli_mismatched/test-00000-of-00001.parquetData1.3 MBe5078398d5c8
mnli_mismatched/validation-00000-of-00001.parquetData1.3 MB04aba92823a9
mrpc/test-00000-of-00001.parquetData308.4 KBa623ed1cbdf4
mrpc/train-00000-of-00001.parquetData649.3 KB61fd41301e0e
mrpc/validation-00000-of-00001.parquetData75.7 KB33c007dbf5bf
qnli/test-00000-of-00001.parquetData877.3 KBf39520cd0792
qnli/train-00000-of-00001.parquetData17.5 MBebc7cb70a5bb
qnli/validation-00000-of-00001.parquetData872.1 KBe69311b81dc6
qqp/test-00000-of-00001.parquetData36.7 MB95d5d1efcfa3
qqp/train-00000-of-00001.parquetData33.6 MB4d6f02e643f7
qqp/validation-00000-of-00001.parquetData3.7 MBefd86a539c41
rte/test-00000-of-00001.parquetData621.4 KB3f44aadbfb8b
rte/train-00000-of-00001.parquetData584.0 KBa6252ab17015
rte/validation-00000-of-00001.parquetData69.0 KBfb2aa2e04f55
sst2/test-00000-of-00001.parquetData147.8 KBe9d23cf00672
sst2/train-00000-of-00001.parquetData3.1 MB66a253e67968
sst2/validation-00000-of-00001.parquetData72.8 KBa1371f3b3a7b
stsb/test-00000-of-00001.parquetData114.3 KB04fa2561f1ff
stsb/train-00000-of-00001.parquetData502.1 KBbbd93bbb988f
stsb/validation-00000-of-00001.parquetData150.6 KB152de7cf1fa3
wnli/test-00000-of-00001.parquetData13.6 KB766d3754c46a
wnli/train-00000-of-00001.parquetData38.8 KB40f4c0c60db6
wnli/validation-00000-of-00001.parquetData11.1 KB880037e45e03
README.mdDocumentation35.3 KB—
.gitattributesRepository1.2 KB—

License and Download

License
other
Access
No access gate
Download from NYU Machine Learning for Language

Released by NYU Machine Learning for Language through its official repository on Hugging Face.

Models Trained on This Dataset