A packed pretraining corpus with 100,000,000,000 training input positions and 10,000,000 held-out validation positions, prepared for the recurrent Purrence Hyperbullet language model.
Rows—
Configurations—
Size266.1 GB
License—
AccessPublicly accessible
Monthly Downloads—
Dataset Card
A packed pretraining corpus with 100,000,000,000 training input positions and 10,000,000 held-out validation positions, prepared for the recurrent Purrence Hyperbullet language model. It uses a frozen 2,048-ID tokenizer (2,047 ordinary IDs plus structural boundary ID 2,047). Upload status: consider this repository complete only when UPLOADCOMPLETE.json is present. That receipt identifies the immutable data revision whose remote file sizes and checksums were verified. This is a custom memory-mapped corpus, not a Parquet dataset for datasets.loaddataset. Download the core training files with the Hugging Face Hub client: For reproducibility, pass the revision from UPLOADCOMPLETE.json after…
Excerpt from the card by Jon Su.
Details
- Repository
- Jonnester/purrence-hyperbullet-100b
- Publisher
- Jon Su
- Task category
- Text generation
- Tags
- pretraining, tokenized, recurrent-language-model
- Size category
- 10M<n<100M
- Languages
- en
- Revision
- a828e8600ad806fac0aaa8227dcb86752b1872a5
- Last updated
- 2026-09-29
Files
114 files, 266.1 GB in total.
Data10 files · 271.6 KB
Tokenizer1 file · 122.9 KB
Documentation1 file · 5.9 KB
Other101 files · 266.1 GB
Repository1 file · 3.4 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| UPLOAD_COMPLETE.json | Data | 12.3 KB | — |
| corpus/exclusions.json | Data | 1.1 KB | — |
| corpus/frozen-character-classes.json | Data | 57.4 KB | — |
| corpus/manifest.json | Data | 6.5 KB | — |
| corpus/source-manifest.json | Data | 81.4 KB | — |
| corpus/verification.json | Data | 30.4 KB | — |
| inspection-summary.json | Data | 1.9 KB | — |
| tokenizer/artifact.json | Data | 4.7 KB | — |
| tokenizer/reconciliation.json | Data | 18.4 KB | — |
| tokenizer/splintr-compatibility.json | Data | 57.4 KB | — |
| README.md | Documentation | 5.9 KB | — |
| SHA256SUMS | Other | 3.6 KB | — |
| corpus/fit-hashes.bin | Other | 39.5 MB | 842b01f56cb4 |
| corpus/holdout-hashes.bin | Other | 789.9 KB | 12540a12e442 |
| corpus/tokens.bin | Other | 222.1 GB | 63f36b3096b9 |
| corpus/train-dclm.digests | Other | 163.9 MB | 501ba137527e |
| corpus/train-dclm.idx | Other | 122.9 MB | 9e2f4273c4c6 |
| corpus/train-finemath.digests | Other | 214.1 MB | e823ea79b7cf |
| corpus/train-finemath.idx | Other | 160.6 MB | 48731a7835ce |
| corpus/train-fineweb_edu.digests | Other | 194.4 MB | f7b7447320b9 |
| corpus/train-fineweb_edu.idx | Other | 145.8 MB | ec6279355d32 |
| corpus/train-swallowcode.digests | Other | 50.0 MB | 69d5ca470116 |
| corpus/train-swallowcode.idx | Other | 37.5 MB | 723fd989057d |
| corpus/train-ufw_multi.digests | Other | 1.6 GB | 2c3a2999d91d |
| corpus/train-ufw_multi.idx | Other | 1.2 GB | 78f06b6bf932 |
| corpus/train-ufw_qa.digests | Other | 484.6 MB | e58edc3e14af |
| corpus/train-ufw_qa.idx | Other | 363.5 MB | c5a24a5a490c |
| corpus/validation-dclm.digests | Other | 14.6 KB | — |
| corpus/validation-dclm.idx | Other | 10.9 KB | — |
| corpus/validation-finemath.digests | Other | 22.4 KB | — |
| corpus/validation-finemath.idx | Other | 16.8 KB | — |
| corpus/validation-fineweb_edu.digests | Other | 19.6 KB | — |
| corpus/validation-fineweb_edu.idx | Other | 14.7 KB | — |
| corpus/validation-swallowcode.digests | Other | 4.9 KB | — |
| corpus/validation-swallowcode.idx | Other | 3.6 KB | — |
| corpus/validation-ufw_multi.digests | Other | 162.2 KB | bb1c64f6a4a9 |
| corpus/validation-ufw_multi.idx | Other | 121.7 KB | 6fee7e73c604 |
| corpus/validation-ufw_qa.digests | Other | 49.1 KB | — |
| corpus/validation-ufw_qa.idx | Other | 36.8 KB | — |
| streaming-v1-seed17/shards/000000.bin | Other | 536.9 MB | 86e231230ccd |
| streaming-v1-seed17/shards/000001.bin | Other | 536.9 MB | 996b72c3d0e6 |
| streaming-v1-seed17/shards/000002.bin | Other | 536.9 MB | 7c91f750aa92 |
| streaming-v1-seed17/shards/000003.bin | Other | 536.9 MB | 40fccf499fbd |
| streaming-v1-seed17/shards/000004.bin | Other | 536.9 MB | bb11220bbf05 |
| streaming-v1-seed17/shards/000005.bin | Other | 536.9 MB | 35f232a42ce8 |
| streaming-v1-seed17/shards/000006.bin | Other | 536.9 MB | 4fba269548c2 |
| streaming-v1-seed17/shards/000007.bin | Other | 536.9 MB | db2472965462 |
| streaming-v1-seed17/shards/000008.bin | Other | 536.9 MB | 0e95ee5f7aba |
| streaming-v1-seed17/shards/000009.bin | Other | 536.9 MB | ad3ea129aca9 |
| streaming-v1-seed17/shards/000010.bin | Other | 536.9 MB | 4502074ab61d |
| streaming-v1-seed17/shards/000011.bin | Other | 536.9 MB | 97536a311db8 |
| streaming-v1-seed17/shards/000012.bin | Other | 536.9 MB | ac3e2da108ad |
| streaming-v1-seed17/shards/000013.bin | Other | 536.9 MB | ccd247980605 |
| streaming-v1-seed17/shards/000014.bin | Other | 536.9 MB | 1a9a542930d4 |
| streaming-v1-seed17/shards/000015.bin | Other | 536.9 MB | f324d31c870b |
| streaming-v1-seed17/shards/000016.bin | Other | 536.9 MB | fee2d7cee803 |
| streaming-v1-seed17/shards/000017.bin | Other | 536.9 MB | b601f184b20b |
| streaming-v1-seed17/shards/000018.bin | Other | 536.9 MB | 9bf9bf82fa5f |
| streaming-v1-seed17/shards/000019.bin | Other | 536.9 MB | 58b90c0da8c5 |
| streaming-v1-seed17/shards/000020.bin | Other | 536.9 MB | 3ec4cfd84554 |
| streaming-v1-seed17/shards/000021.bin | Other | 536.9 MB | bc6a559c90ef |
| streaming-v1-seed17/shards/000022.bin | Other | 536.9 MB | 3d70ea695e9f |
| streaming-v1-seed17/shards/000023.bin | Other | 536.9 MB | e03b3cf80351 |
| streaming-v1-seed17/shards/000024.bin | Other | 536.9 MB | ea6344ee3b6a |
| streaming-v1-seed17/shards/000025.bin | Other | 536.9 MB | 060a67603f92 |
| streaming-v1-seed17/shards/000026.bin | Other | 536.9 MB | ba956ed8b862 |
| streaming-v1-seed17/shards/000027.bin | Other | 536.9 MB | 9d7a7f9e48e6 |
| streaming-v1-seed17/shards/000028.bin | Other | 536.9 MB | 0a1f79ad7ea3 |
| streaming-v1-seed17/shards/000029.bin | Other | 536.9 MB | 7140e4bc34ae |
| streaming-v1-seed17/shards/000030.bin | Other | 536.9 MB | c1e12486f607 |
| streaming-v1-seed17/shards/000031.bin | Other | 536.9 MB | f58d7f151937 |
| streaming-v1-seed17/shards/000032.bin | Other | 536.9 MB | 96306d3eaf79 |
| streaming-v1-seed17/shards/000033.bin | Other | 536.9 MB | 71ee352103ea |
| streaming-v1-seed17/shards/000034.bin | Other | 536.9 MB | c53a2836bfc6 |
| streaming-v1-seed17/shards/000035.bin | Other | 536.9 MB | c64f5e3366fe |
| streaming-v1-seed17/shards/000036.bin | Other | 536.9 MB | c5357135601f |
| streaming-v1-seed17/shards/000037.bin | Other | 536.9 MB | 800e8e5e7fb9 |
| streaming-v1-seed17/shards/000038.bin | Other | 536.9 MB | 7c743deff4be |
| streaming-v1-seed17/shards/000039.bin | Other | 536.9 MB | 260c6f7befb3 |
| streaming-v1-seed17/shards/000040.bin | Other | 536.9 MB | 74a3f20cecd0 |
| streaming-v1-seed17/shards/000041.bin | Other | 536.9 MB | 379b684a320b |
| streaming-v1-seed17/shards/000042.bin | Other | 536.9 MB | 54d1b9127d54 |
| streaming-v1-seed17/shards/000043.bin | Other | 536.9 MB | c2a7e232afa5 |
| streaming-v1-seed17/shards/000044.bin | Other | 536.9 MB | c1c0428259c9 |
| streaming-v1-seed17/shards/000045.bin | Other | 536.9 MB | 5b3b83c2d531 |
| streaming-v1-seed17/shards/000046.bin | Other | 536.9 MB | 881f78ae1ad2 |
| streaming-v1-seed17/shards/000047.bin | Other | 536.9 MB | 4d5ea5b43799 |
| streaming-v1-seed17/shards/000048.bin | Other | 536.9 MB | 4924cf31d051 |
| streaming-v1-seed17/shards/000049.bin | Other | 536.9 MB | 46c989981863 |
| streaming-v1-seed17/shards/000050.bin | Other | 536.9 MB | a0ac4c876308 |
| streaming-v1-seed17/shards/000051.bin | Other | 536.9 MB | b00b058f0214 |
| streaming-v1-seed17/shards/000052.bin | Other | 536.9 MB | dcf5deb74da5 |
| streaming-v1-seed17/shards/000053.bin | Other | 536.9 MB | 8eab91da6665 |
| streaming-v1-seed17/shards/000054.bin | Other | 536.9 MB | 1c594bfa3aaf |
| streaming-v1-seed17/shards/000055.bin | Other | 536.9 MB | a921f303b818 |
| streaming-v1-seed17/shards/000056.bin | Other | 536.9 MB | 620c6b9b9ced |
| streaming-v1-seed17/shards/000057.bin | Other | 536.9 MB | 6d1b0aae2d79 |
| streaming-v1-seed17/shards/000058.bin | Other | 536.9 MB | 9fa5034a2372 |
| streaming-v1-seed17/shards/000059.bin | Other | 536.9 MB | d9c01c572086 |
| streaming-v1-seed17/shards/000060.bin | Other | 536.9 MB | 7122be5b7107 |
| streaming-v1-seed17/shards/000061.bin | Other | 536.9 MB | 5e6e66a8fdac |
| streaming-v1-seed17/shards/000062.bin | Other | 536.9 MB | 798f0d57324c |
| streaming-v1-seed17/shards/000063.bin | Other | 536.9 MB | 285793e1ed96 |
| streaming-v1-seed17/shards/000064.bin | Other | 536.9 MB | 9fc6939b0b27 |
| streaming-v1-seed17/shards/000065.bin | Other | 536.9 MB | 8d96018927da |
| streaming-v1-seed17/shards/000066.bin | Other | 536.9 MB | 997fcf92a8bd |
| streaming-v1-seed17/shards/000067.bin | Other | 536.9 MB | bf0aff101de4 |
| streaming-v1-seed17/shards/000068.bin | Other | 536.9 MB | fc4bed06569a |
| streaming-v1-seed17/shards/000069.bin | Other | 536.9 MB | b6910e13a936 |
| streaming-v1-seed17/shards/000070.bin | Other | 536.9 MB | fb3e83c098e9 |
| streaming-v1-seed17/shards/000071.bin | Other | 536.9 MB | c6d34b518dc5 |
| streaming-v1-seed17/shards/000072.bin | Other | 536.9 MB | 1b5e9e2343a2 |
| .gitattributes | Repository | 3.4 KB | — |
| tokenizer/ordinary-tokenizer.json | Tokenizer | 122.9 KB | — |
License and Download
- License
- Not stated by the source
- Access
- No access gate
Download from Jon Su
Released by Jon Su through its official repository on Hugging Face.