The task of PubMedQA is to answer research questions with yes/no/maybe (e.g.: Do preoperative statins reduce atrial fibrillation after coronary artery bypass grafting?) using the corresponding abstracts.
Dataset Card
By Qiao Jin, published under mit, revision 9001f2853fb8.
Dataset Card for [Dataset Name]
Table of Contents
- Dataset Description
- Dataset Summary
- Supported Tasks and Leaderboards
- Languages
- Dataset Structure
- Data Instances
- Data Fields
- Data Splits
- Dataset Creation
- Curation Rationale
- Source Data
- Annotations
- Personal and Sensitive Information
- Considerations for Using the Data
- Social Impact of Dataset
- Discussion of Biases
- Other Known Limitations
- Additional Information
- Dataset Curators
- Licensing Information
- Citation Information
- Contributions
Dataset Description
- Homepage: PubMedQA homepage
- Repository: PubMedQA repository
- Paper: PubMedQA: A Dataset for Biomedical Research Question Answering
- Leaderboard: PubMedQA: Leaderboard
Dataset Summary
The task of PubMedQA is to answer research questions with yes/no/maybe (e.g.: Do preoperative statins reduce atrial fibrillation after coronary artery bypass grafting?) using the corresponding abstracts.
Supported Tasks and Leaderboards
The official leaderboard is available at: https://pubmedqa.github.io/.
500 questions in the pqa_labeled are used as the test set. They can be found at https://github.com/pubmedqa/pubmedqa.
Languages
English
Dataset Structure
Data Instances
[More Information Needed]
Data Fields
[More Information Needed]
Data Splits
[More Information Needed]
Dataset Creation
Curation Rationale
Structure
pqa_artificial 211,269 rows
| Split | Rows | Size |
|---|---|---|
| train | 211,269 | 446.8 MB |
pqa_labeled 1,000 rows
| Split | Rows | Size |
|---|---|---|
| train | 1,000 | 2.1 MB |
pqa_unlabeled 61,249 rows
| Split | Rows | Size |
|---|---|---|
| train | 61,249 | 126.7 MB |
Details
- Repository
- qiaojin/PubMedQA
- Publisher
- Qiao Jin
- Task category
- Question answering
- Tags
- Not stated by the source
- Size category
- 100K<n<1M
- Languages
- en
- Revision
- 9001f2853fb87cab8d220904e0de81ac6973b318
- Last updated
- 2024-03-06
Files
5 files, 300.5 MB in total.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| pqa_artificial/train-00000-of-00001.parquet | Data | 233.4 MB | cdee2d3c0136 |
| pqa_labeled/train-00000-of-00001.parquet | Data | 1.1 MB | 3d56bd1abc11 |
| pqa_unlabeled/train-00000-of-00001.parquet | Data | 66.0 MB | 2f390ea5e6e3 |
| README.md | Documentation | 5.2 KB | — |
| .gitattributes | Repository | 1.2 KB | — |
License and Download
- License
- mit
- Access
- No access gate
Released by Qiao Jin through its official repository on Hugging Face. Read the license.
Models Trained on This Dataset
- Trained on (disclosed)Llama-3.1-8B-Instruct-Medical-Finetuned-merged