Evaluation sets for the released NCM checkpoints.
Rows—
Configurations—
Size22.7 GB
Licensemit
AccessPublicly accessible
Monthly Downloads108
Dataset Card
By HazyResearch, published under mit, revision 6580ba41a4b0.
Evaluation sets for the released NCM checkpoints.
- Paper: Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation
- Project page: Hazy Research blog post
- Code: GitHub repository
| folder | files | contents |
|---|---|---|
xsum/ |
passages.pickle, reference_summaries.pickle |
the complete XSum test set as tokenized article rows with summary slots, and the untruncated reference summaries as strings |
wmt14/ |
sources.pickle, reference_translations.pickle |
the WMT newstest German sources and English references as strings |
sudoku/{easy,medium,hard}/ |
puzzles.pickle, solutions.pickle |
held-out boards per difficulty: puzzle prefixes and completed grids as token lists |
lm1b/ |
train_bert_30522.bin, valid_bert_30522.bin and their _offsets.npy files |
One Billion Word training and validation token streams with sequence offsets |
tinystories/ |
train_bpe_8192.bin, train_bpe_8192.pickle, valid_bpe_8192.bin, valid_bpe_8192.pickle, offsets and the BPE vocabulary and merges |
TinyStories training and validation token streams under the custom BPE tokenizer |
owt/ |
train_gpt2.bin, valid_gpt2.bin and their _offsets.npy files |
OpenWebText training and validation token streams with document offsets |
Citation
@misc{kumbong2026nextconcept,
title = {Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation},
author = {Kumbong, Hermann and Khare, Ishan S. and Mlauzi, Iddah and Woen, Andrew and Ding, Charles and Buchanan, E. Kelly and Arora, Simran and Mirhoseini, Azalia and R{\'e}, Christopher},
year = {2026},
eprint={2610.14162},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2610.14162},
}
Details
- Repository
- hazyresearch/ncm-datasets
- Publisher
- HazyResearch
- Task category
- Text generation
- Tags
- Not stated by the source
- Size category
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 6580ba41a4b0a976dde876fbe84d25327617b0e6
- Last updated
- 2026-10-16
Files
30 files, 22.7 GB in total.
Documentation4 files · 2.5 KB
Other25 files · 22.7 GB
Repository1 file · 2.5 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| README.md | Documentation | 2.0 KB | — |
| lm1b/README.md | Documentation | 155 B | — |
| owt/README.md | Documentation | 142 B | — |
| tinystories/README.md | Documentation | 245 B | — |
| lm1b/train_bert_30522.bin | Other | 1.8 GB | d434e454d3c6 |
| lm1b/train_bert_30522_offsets.npy | Other | 56.7 MB | 454624ab4bbc |
| lm1b/valid_bert_30522.bin | Other | 18.4 MB | acfaa554bbb7 |
| lm1b/valid_bert_30522_offsets.npy | Other | 574.7 KB | d328d2509876 |
| owt/train_gpt2.bin | Other | 18.1 GB | b24b78a07f56 |
| owt/train_gpt2_offsets.npy | Other | 64.1 MB | 7e84564946b8 |
| owt/valid_gpt2.bin | Other | 9.2 MB | 1f2ee17e0832 |
| owt/valid_gpt2_offsets.npy | Other | 32.1 KB | 09a748ce1dce |
| sudoku/easy/puzzles.pickle | Other | 372.1 KB | 403353dd5d11 |
| sudoku/easy/solutions.pickle | Other | 364.1 KB | b52de75f5e46 |
| sudoku/hard/puzzles.pickle | Other | 372.1 KB | dd7b6763e559 |
| sudoku/hard/solutions.pickle | Other | 364.1 KB | b52de75f5e46 |
| sudoku/medium/puzzles.pickle | Other | 372.1 KB | d49cd2b380bd |
| sudoku/medium/solutions.pickle | Other | 364.1 KB | b52de75f5e46 |
| tinystories/bpe_merges_8192.pickle | Other | 108.3 KB | 0d4cab13f2e7 |
| tinystories/bpe_vocab_8192.pickle | Other | 95.1 KB | fb176b4c6810 |
| tinystories/train_bpe_8192.bin | Other | 1.1 GB | b1dccdf7562f |
| tinystories/train_bpe_8192.pickle | Other | 1.5 GB | 278847cc2cd4 |
| tinystories/train_bpe_8192_offsets.npy | Other | 21.7 MB | c45c0471bc3f |
| tinystories/valid_bpe_8192.bin | Other | 11.0 MB | e5c9825a84cf |
| tinystories/valid_bpe_8192.pickle | Other | 15.6 MB | f4723c2b0e4c |
| wmt14/reference_translations.pickle | Other | 366.3 KB | 3dcef81d8aed |
| wmt14/sources.pickle | Other | 406.1 KB | 62254653c32c |
| xsum/passages.pickle | Other | 18.5 MB | 39b820f0a71d |
| xsum/reference_summaries.pickle | Other | 1.5 MB | db624e065b66 |
| .gitattributes | Repository | 2.5 KB | — |
License and Download
- License
- mit
- Access
- No access gate
Download from HazyResearch
Released by HazyResearch through its official repository on Hugging Face. Read the license.