SAVRN
Search Contact SAVRN

Dataset · Question answering

commonsense_qa

by Tel Aviv University tau/commonsense_qa

CommonsenseQA is a new multiple-choice question answering dataset that requires different types of commonsense knowledge to predict the correct answers. It contains 12,102 questions with one correct answer and four distractor answers.

Rows12,102
Configurations1
Size1.6 MB
Licensemit
AccessPublicly accessible
Monthly Downloads308.4k

Dataset Card

By Tel Aviv University, published under mit, revision 94630fe30dad.

Dataset Card for "commonsense_qa"

Table of Contents

  • Table of Contents
  • Dataset Description
  • Dataset Summary
  • Supported Tasks and Leaderboards
  • Languages
  • Dataset Structure
  • Data Instances
  • Data Fields
  • Data Splits
  • Dataset Creation
  • Curation Rationale
  • Source Data
  • Annotations
  • Personal and Sensitive Information
  • Considerations for Using the Data
  • Social Impact of Dataset
  • Discussion of Biases
  • Other Known Limitations
  • Additional Information
  • Dataset Curators
  • Licensing Information
  • Citation Information
  • Contributions

Dataset Description

  • Homepage: https://www.tau-nlp.org/commonsenseqa
  • Repository: https://github.com/jonathanherzig/commonsenseqa
  • Paper: https://arxiv.org/abs/1811.00937
  • Point of Contact: More Information Needed
  • Size of downloaded dataset files: 4.68 MB
  • Size of the generated dataset: 2.18 MB
  • Total amount of disk used: 6.86 MB

Dataset Summary

CommonsenseQA is a new multiple-choice question answering dataset that requires different types of commonsense knowledge to predict the correct answers . It contains 12,102 questions with one correct answer and four distractor answers. The dataset is provided in two major training/validation/testing set splits: "Random split" which is the main evaluation split, and "Question token split", see paper for details.

Read the full dataset card (505 words)

Structure

default 12,102 rows

SplitRowsSize
train9,7412.2 MB
validation1,221274.3 KB
test1,140257.4 KB
idstringquestionstringquestion_conceptstringchoicesSequenceanswerKeystring

Details

Repository
tau/commonsense_qa
Publisher
Tel Aviv University
Task category
Question answering
Tags
Not stated by the source
Size category
1K<n<10K
Languages
en
Revision
94630fe30dad47192a8546eb75f094926d47e155
Last updated
2024-01-04

Files

5 files, 1.6 MB in total.

Data3 files · 1.6 MB
Documentation1 file · 7.4 KB
Repository1 file · 1.2 KB
Every file
FileTypeSizeSHA-256
data/test-00000-of-00001.parquetData151.2 KB19efe93223d1
data/train-00000-of-00001.parquetData1.2 MBb0449767ed98
data/validation-00000-of-00001.parquetData160.2 KBbdbd9bf9cc4d
README.mdDocumentation7.4 KB
.gitattributesRepository1.2 KB

License and Download

License
mit
Access
No access gate
Download from Tel Aviv University

Released by Tel Aviv University through its official repository on Hugging Face. Read the license.