Dataset · Voice activity detection
semantic-vad-eot
by Scicom (MSC) BHD Scicom-intl/semantic-vad-eot
End-of-turn (semantic VAD) turns built from word-level forced alignments, schema-compatible with livekit/eot-bench-data. Each row is one user turn: an audio clip (16 kHz mp3), its words, and ordered silencespans.
Rows13,151,686
Configurations12
Size154.3 GB
Licensecc-by-4.0
AccessPublicly accessible
Monthly Downloads4.7k
Dataset Card
By Scicom (MSC) BHD, published under cc-by-4.0, revision eae362fcb09d.
End-of-turn (semantic VAD) turns built from word-level forced alignments, schema-compatible
with livekit/eot-bench-data.
Each row is one user turn: an audio clip (16 kHz mp3), its words, and ordered
silence_spans. Per the eot-bench convention the last silence span is the true
end-of-turn (eot); earlier spans are mid-turn hold pauses (labels positional, not stored).
Splits
For every data type, all shards except the last form the train base; that type's last shard is split 50/25/25 into extra train / validation / test (shuffled, seed 42).
Configs (viewer dropdown)
all(default) — every language + Malaysian subset.- 13 languages:
en, fr, de, it, ja, ko, zh, pl, pt, ru, es, th, tr. - 5 Malaysian subsets (word-level, no synthetic):
ms_dialects, ms_imda, ms_malaysian, ms_parliament, ms_science_english.
Sources: AAdonis/multilingual_audio_alignments, malaysia-ai/Malaysian-STT.
from datasets import load_dataset, Audio
ds = load_dataset("Scicom-intl/semantic-vad-eot", "en") # ('train', 'validation', 'test')
te = load_dataset("Scicom-intl/semantic-vad-eot", "ms_imda", split="test")
ds = ds.cast_column("audio", Audio(decode=False))
Structure
all 7,901,677 rows
| Split | Rows | Size |
|---|---|---|
| train | 7,731,608 | 158.7 GB |
| validation | 85,010 | 1.9 GB |
| test | 85,059 | 1.9 GB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
de 474,206 rows
| Split | Rows | Size |
|---|---|---|
| train | 464,206 | 9.8 GB |
| validation | 5,000 | 104.2 MB |
| test | 5,000 | 104.5 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
en 482,662 rows
| Split | Rows | Size |
|---|---|---|
| train | 472,662 | 8.4 GB |
| validation | 5,000 | 88.3 MB |
| test | 5,000 | 87.7 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
es 484,489 rows
| Split | Rows | Size |
|---|---|---|
| train | 474,489 | 10.6 GB |
| validation | 5,000 | 116.4 MB |
| test | 5,000 | 115.7 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
fr 475,609 rows
| Split | Rows | Size |
|---|---|---|
| train | 465,609 | 11.7 GB |
| validation | 5,000 | 179.3 MB |
| test | 5,000 | 180.4 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
it 476,552 rows
| Split | Rows | Size |
|---|---|---|
| train | 466,552 | 27.4 GB |
| validation | 5,000 | 290.0 MB |
| test | 5,000 | 290.6 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
ja 98,265 rows
| Split | Rows | Size |
|---|---|---|
| train | 88,265 | 980.3 MB |
| validation | 5,000 | 84.8 MB |
| test | 5,000 | 82.9 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
ko 412,943 rows
| Split | Rows | Size |
|---|---|---|
| train | 402,943 | 6.1 GB |
| validation | 5,000 | 70.3 MB |
| test | 5,000 | 67.9 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
ms_dialects 1,660,298 rows
| Split | Rows | Size |
|---|---|---|
| train | 1,651,060 | 23.8 GB |
| validation | 4,609 | 69.2 MB |
| test | 4,629 | 67.7 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
ms_imda 258,153 rows
| Split | Rows | Size |
|---|---|---|
| train | 249,495 | 5.1 GB |
| validation | 4,304 | 102.6 MB |
| test | 4,354 | 106.0 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
ms_malaysian 369,484 rows
| Split | Rows | Size |
|---|---|---|
| train | 360,312 | 8.8 GB |
| validation | 4,600 | 111.6 MB |
| test | 4,572 | 111.9 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
ms_parliament 57,348 rows
| Split | Rows | Size |
|---|---|---|
| train | 47,779 | 1.3 GB |
| validation | 4,783 | 132.8 MB |
| test | 4,786 | 135.6 MB |
idstringaudioAudiolanguagestringdurationfloat64silence_spanslistwordslistmessageslist
Details
- Repository
- Scicom-intl/semantic-vad-eot
- Publisher
- Scicom (MSC) BHD
- Task category
- Voice activity detection
- Tags
- end-of-turn, semantic-vad, eot
- Size category
- Not stated by the source
- Languages
- en, fr, de, it, ja, ko, zh, pl
- Revision
- eae362fcb09d8d36b58a3923cadcf9c8fbdaf81a
- Last updated
- 2026-09-18
Files
498 files, 154.3 GB in total.
Data496 files · 154.3 GB
Documentation1 file · 6.5 KB
Repository1 file · 2.5 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| data/ml-english-00000.parquet | Data | 322.7 MB | 09fa2eb9b539 |
| data/ml-english-00001.parquet | Data | 324.3 MB | d23cc6eaa500 |
| data/ml-english-00002.parquet | Data | 323.9 MB | 52081b192d8f |
| data/ml-english-00003.parquet | Data | 327.0 MB | 3a977df53443 |
| data/ml-english-00004.parquet | Data | 325.2 MB | 4577c72f5916 |
| data/ml-english-00005.parquet | Data | 319.7 MB | 9e5e8e683bbc |
| data/ml-english-00006.parquet | Data | 322.3 MB | 1abef94f56ab |
| data/ml-english-00007.parquet | Data | 324.5 MB | 1dfd27245376 |
| data/ml-english-00008.parquet | Data | 324.1 MB | dbe66e7d9494 |
| data/ml-english-00009.parquet | Data | 323.4 MB | 32f33412a4aa |
| data/ml-english-00010.parquet | Data | 323.6 MB | 83589f75ff6c |
| data/ml-english-00011.parquet | Data | 322.6 MB | 84a6de367852 |
| data/ml-english-00012.parquet | Data | 323.7 MB | b2bf4c30bc02 |
| data/ml-english-00013.parquet | Data | 324.2 MB | 31ed608135e3 |
| data/ml-english-00014.parquet | Data | 322.7 MB | 502fd5f95f96 |
| data/ml-english-00015.parquet | Data | 325.3 MB | 0457c90f6d9d |
| data/ml-english-00016.parquet | Data | 325.1 MB | 8f21daebccee |
| data/ml-english-00017.parquet | Data | 320.6 MB | 7c1953f652e2 |
| data/ml-english-00018.parquet | Data | 323.2 MB | 40bfbc4ac0e6 |
| data/ml-english-00019.parquet | Data | 323.9 MB | 58efb309258b |
| data/ml-english-00020.parquet | Data | 320.1 MB | f4a1885ea0e2 |
| data/ml-english-00021.parquet | Data | 321.9 MB | 01e08ae52174 |
| data/ml-english-00022.parquet | Data | 324.3 MB | 99d038e18248 |
| data/ml-english-00023.parquet | Data | 323.6 MB | 73d73f2daf58 |
| data/ml-french-00000.parquet | Data | 207.4 MB | 07ece884f3e8 |
| data/ml-french-00001.parquet | Data | 206.3 MB | 86fcb97264ce |
| data/ml-french-00002.parquet | Data | 208.7 MB | 2629963e030f |
| data/ml-french-00003.parquet | Data | 209.9 MB | 0879ce0948dd |
| data/ml-french-00004.parquet | Data | 208.5 MB | e8a92c8cce62 |
| data/ml-french-00005.parquet | Data | 205.6 MB | 9df843a9c829 |
| data/ml-french-00006.parquet | Data | 208.6 MB | f3e9eeaa44b2 |
| data/ml-french-00007.parquet | Data | 208.8 MB | d333f8622689 |
| data/ml-french-00008.parquet | Data | 206.6 MB | 9564e53efdb6 |
| data/ml-french-00009.parquet | Data | 240.4 MB | 4caee97a454e |
| data/ml-french-00010.parquet | Data | 506.9 MB | 7c8e4f013723 |
| data/ml-french-00011.parquet | Data | 566.6 MB | 8c2670f38efd |
| data/ml-french-00012.parquet | Data | 572.3 MB | 420324f1751a |
| data/ml-french-00013.parquet | Data | 576.2 MB | 1854f7893119 |
| data/ml-french-00014.parquet | Data | 599.0 MB | 19dfbb1ec4c1 |
| data/ml-french-00015.parquet | Data | 545.3 MB | ed2ddcb55239 |
| data/ml-french-00016.parquet | Data | 622.9 MB | 1256df9f689b |
| data/ml-french-00017.parquet | Data | 621.3 MB | 7e747c4ade3f |
| data/ml-french-00018.parquet | Data | 628.9 MB | 0b826abe8990 |
| data/ml-french-00019.parquet | Data | 626.8 MB | b9c895bc2fd0 |
| data/ml-french-00020.parquet | Data | 627.3 MB | 09b2500b3dd8 |
| data/ml-french-00021.parquet | Data | 604.3 MB | 7432c938012f |
| data/ml-french-00022.parquet | Data | 663.6 MB | 51148a0ced4c |
| data/ml-french-00023.parquet | Data | 663.9 MB | d2edc5b05fab |
| data/ml-german-00000.parquet | Data | 397.5 MB | 016bb27e1ffe |
| data/ml-german-00001.parquet | Data | 388.5 MB | d4a606e7c524 |
| data/ml-german-00002.parquet | Data | 379.8 MB | bb69c02344d4 |
| data/ml-german-00003.parquet | Data | 366.3 MB | e1222193bddc |
| data/ml-german-00004.parquet | Data | 375.0 MB | d92ffdf464f2 |
| data/ml-german-00005.parquet | Data | 393.0 MB | 6f51829b17d3 |
| data/ml-german-00006.parquet | Data | 390.3 MB | bf9a0867fb04 |
| data/ml-german-00007.parquet | Data | 391.6 MB | 1cb0db39f854 |
| data/ml-german-00008.parquet | Data | 379.8 MB | 284043ff79fb |
| data/ml-german-00009.parquet | Data | 388.8 MB | 8db0d699378f |
| data/ml-german-00010.parquet | Data | 369.8 MB | 5b0324aa5ec9 |
| data/ml-german-00011.parquet | Data | 361.2 MB | 276237d9246a |
| data/ml-german-00012.parquet | Data | 347.5 MB | 40a316b099b4 |
| data/ml-german-00013.parquet | Data | 344.8 MB | 493684f7dfa3 |
| data/ml-german-00014.parquet | Data | 343.4 MB | 8cc367411b1d |
| data/ml-german-00015.parquet | Data | 352.5 MB | 22a27fb033fe |
| data/ml-german-00016.parquet | Data | 344.9 MB | 32a9393eed58 |
| data/ml-german-00017.parquet | Data | 353.6 MB | 9c0546614ae4 |
| data/ml-german-00018.parquet | Data | 351.5 MB | 154cd4f08865 |
| data/ml-german-00019.parquet | Data | 357.4 MB | 866dcf678b6c |
| data/ml-german-00020.parquet | Data | 350.4 MB | db050d25dc18 |
| data/ml-german-00021.parquet | Data | 345.1 MB | 173f116156d4 |
| data/ml-german-00022.parquet | Data | 354.0 MB | b6b747979138 |
| data/ml-german-00023.parquet | Data | 352.0 MB | b2fab0d32ccb |
| data/ml-italian-00000.parquet | Data | 1.1 GB | c970c4e8da48 |
| data/ml-italian-00001.parquet | Data | 1.1 GB | ffca3c9c2322 |
| data/ml-italian-00002.parquet | Data | 1.1 GB | b3d2ed98ce6c |
| data/ml-italian-00003.parquet | Data | 1.1 GB | 362cec7a7ace |
| data/ml-italian-00004.parquet | Data | 1.1 GB | 13003e2c6f7e |
| data/ml-italian-00005.parquet | Data | 1.1 GB | 867d33c4b1f4 |
| data/ml-italian-00006.parquet | Data | 1.1 GB | ec327af8853c |
| data/ml-italian-00007.parquet | Data | 1.1 GB | e6573e688fee |
| data/ml-italian-00008.parquet | Data | 1.1 GB | e7fa6b3b6b94 |
| data/ml-italian-00009.parquet | Data | 1.1 GB | b8ee6b1f4d30 |
| data/ml-italian-00010.parquet | Data | 1.1 GB | a834e8cf6f09 |
| data/ml-italian-00011.parquet | Data | 1.1 GB | 720f722419e9 |
| data/ml-italian-00012.parquet | Data | 1.1 GB | e9285f7b206b |
| data/ml-italian-00013.parquet | Data | 1.1 GB | 519f87dc244b |
| data/ml-italian-00014.parquet | Data | 1.1 GB | 57bde71de82b |
| data/ml-italian-00015.parquet | Data | 1.1 GB | 232df33d471f |
| data/ml-italian-00016.parquet | Data | 1.1 GB | c1a8ff3c15ee |
| data/ml-italian-00017.parquet | Data | 1.1 GB | 65aba76834fe |
| data/ml-italian-00018.parquet | Data | 1.1 GB | 21c6f54ed3ad |
| data/ml-italian-00019.parquet | Data | 1.1 GB | 9c1396576b4b |
| data/ml-italian-00020.parquet | Data | 1.1 GB | 7a6c6178fd11 |
| data/ml-italian-00021.parquet | Data | 1.1 GB | 8a003f21ebea |
| data/ml-italian-00022.parquet | Data | 1.1 GB | bede3c00862c |
| data/ml-italian-00023.parquet | Data | 1.1 GB | bb37d4c1094d |
| data/ml-japanese-00000.parquet | Data | 27.8 MB | d199f546194c |
| data/ml-japanese-00001.parquet | Data | 27.9 MB | db08b2b71517 |
| data/ml-japanese-00002.parquet | Data | 28.0 MB | b026eb574d52 |
| data/ml-japanese-00003.parquet | Data | 27.0 MB | 724c3c4ff19a |
| data/ml-japanese-00004.parquet | Data | 27.7 MB | 136de2c661a3 |
| data/ml-japanese-00005.parquet | Data | 27.4 MB | 7f0ec59d348e |
| data/ml-japanese-00006.parquet | Data | 26.6 MB | e5e252ae61ec |
| data/ml-japanese-00007.parquet | Data | 27.8 MB | 945a9b359b94 |
| data/ml-japanese-00008.parquet | Data | 27.7 MB | 142b7ef2d23e |
| data/ml-japanese-00009.parquet | Data | 28.0 MB | 3e020def31fc |
| data/ml-japanese-00010.parquet | Data | 28.6 MB | 38a477133fd9 |
| data/ml-japanese-00011.parquet | Data | 28.4 MB | f3d9ad856f5e |
| data/ml-japanese-00012.parquet | Data | 28.2 MB | e0e19b859a11 |
| data/ml-japanese-00013.parquet | Data | 27.4 MB | ca9b0c4d6e05 |
| data/ml-japanese-00014.parquet | Data | 27.7 MB | 5f4d659ce993 |
| data/ml-japanese-00015.parquet | Data | 28.4 MB | 5e016a7f3d2c |
| data/ml-japanese-00016.parquet | Data | 28.3 MB | da54438ad55c |
| data/ml-japanese-00017.parquet | Data | 28.1 MB | 37d70477da18 |
| data/ml-japanese-00018.parquet | Data | 27.9 MB | 8566b2e2244f |
| data/ml-japanese-00019.parquet | Data | 29.0 MB | acaa8c321628 |
| data/ml-japanese-00020.parquet | Data | 27.5 MB | 058fa685eea5 |
| data/ml-japanese-00021.parquet | Data | 28.6 MB | b70b236074f9 |
| data/ml-japanese-00022.parquet | Data | 27.3 MB | 456b997331f6 |
| data/ml-japanese-00023.parquet | Data | 28.3 MB | 92adf73acb8f |
| data/ml-korean-00000.parquet | Data | 234.3 MB | 72b0fc759806 |
| data/ml-korean-00001.parquet | Data | 234.3 MB | f803335564d5 |
| data/ml-korean-00002.parquet | Data | 235.7 MB | d45ac792da61 |
| data/ml-korean-00003.parquet | Data | 236.8 MB | 51d8feac7f2c |
| data/ml-korean-00004.parquet | Data | 233.7 MB | f23184e410df |
| data/ml-korean-00005.parquet | Data | 235.4 MB | 4971c7d48d2a |
| data/ml-korean-00006.parquet | Data | 233.0 MB | 245e2b4a8086 |
| data/ml-korean-00007.parquet | Data | 233.1 MB | e7cfc1bf5a4f |
| data/ml-korean-00008.parquet | Data | 233.0 MB | 50cdbcb5ab5a |
| data/ml-korean-00009.parquet | Data | 231.6 MB | 3f8fcd223a20 |
| data/ml-korean-00010.parquet | Data | 233.9 MB | 204cb29df46c |
| data/ml-korean-00011.parquet | Data | 235.8 MB | 615aaa734d90 |
| data/ml-korean-00012.parquet | Data | 234.6 MB | 0f2f2d947745 |
| data/ml-korean-00013.parquet | Data | 236.0 MB | 5d40f0a75454 |
| data/ml-korean-00014.parquet | Data | 233.8 MB | 5ecef850537b |
| data/ml-korean-00015.parquet | Data | 235.2 MB | e0bf35d31cf8 |
| data/ml-korean-00016.parquet | Data | 233.5 MB | eb4d0608c1aa |
| data/ml-korean-00017.parquet | Data | 233.7 MB | 2f05235da1a8 |
| data/ml-korean-00018.parquet | Data | 204.2 MB | fb790622abfd |
| data/ml-korean-00019.parquet | Data | 199.1 MB | 4499f238a91e |
| data/ml-korean-00020.parquet | Data | 199.8 MB | 17af6892a2a8 |
| data/ml-korean-00021.parquet | Data | 200.2 MB | 068a2c67dce9 |
| data/ml-korean-00022.parquet | Data | 200.9 MB | 0a771276a05e |
| data/ml-korean-00023.parquet | Data | 200.5 MB | 78643ef922a3 |
| data/ml-mandarin-00000.parquet | Data | 34.8 MB | 8693d5151490 |
| data/ml-mandarin-00001.parquet | Data | 41.0 MB | 90db8c082726 |
| data/ml-mandarin-00002.parquet | Data | 41.6 MB | 5b4fff5790ed |
| data/ml-mandarin-00003.parquet | Data | 41.8 MB | 447f615e8b51 |
| data/ml-mandarin-00004.parquet | Data | 42.0 MB | 453223570490 |
| data/ml-mandarin-00005.parquet | Data | 42.0 MB | f90ce79c8711 |
| data/ml-mandarin-00006.parquet | Data | 40.8 MB | ce7c7b82c261 |
| data/ml-mandarin-00007.parquet | Data | 41.6 MB | d650c090a765 |
| data/ml-mandarin-00008.parquet | Data | 41.7 MB | cea8b4cc50f4 |
| data/ml-mandarin-00009.parquet | Data | 41.7 MB | b9ff5724e9da |
| data/ml-mandarin-00010.parquet | Data | 42.2 MB | 7051e5b2df97 |
| data/ml-mandarin-00011.parquet | Data | 41.5 MB | f4c0e69c6752 |
| data/ml-mandarin-00012.parquet | Data | 42.0 MB | 552e59c1bcfd |
| data/ml-mandarin-00013.parquet | Data | 41.4 MB | 17d2a0f83f76 |
| data/ml-mandarin-00014.parquet | Data | 41.6 MB | f0de3b4bd2b2 |
| data/ml-mandarin-00015.parquet | Data | 41.9 MB | 69092e2747e2 |
| data/ml-mandarin-00016.parquet | Data | 41.8 MB | 59336309d75d |
| data/ml-mandarin-00017.parquet | Data | 41.8 MB | 15776841d408 |
| data/ml-mandarin-00018.parquet | Data | 41.9 MB | 5ec2043ff45a |
| data/ml-mandarin-00019.parquet | Data | 42.2 MB | e3c00f5cd922 |
| data/ml-mandarin-00020.parquet | Data | 42.0 MB | 531c8a8a8925 |
| data/ml-mandarin-00021.parquet | Data | 41.4 MB | 15e11d3032e4 |
| data/ml-mandarin-00022.parquet | Data | 41.5 MB | abe846150101 |
| data/ml-mandarin-00023.parquet | Data | 41.8 MB | 572316c3cc02 |
| data/ml-polish-00000.parquet | Data | 449.3 MB | bef2e9f9bf32 |
| data/ml-polish-00001.parquet | Data | 362.3 MB | 9cd4f2ca1b50 |
| data/ml-polish-00002.parquet | Data | 426.9 MB | fe9b0e0f5f6d |
| data/ml-polish-00003.parquet | Data | 446.2 MB | a5a2bec33403 |
| data/ml-polish-00004.parquet | Data | 402.7 MB | eb3be6b07af3 |
| data/ml-polish-00005.parquet | Data | 391.6 MB | 8ac2054e08de |
| data/ml-polish-00006.parquet | Data | 415.9 MB | 7a5cc43427db |
| data/ml-polish-00007.parquet | Data | 417.9 MB | c6057b2749b6 |
| data/ml-polish-00008.parquet | Data | 452.6 MB | 0cae3609b82b |
| data/ml-polish-00009.parquet | Data | 459.6 MB | ae25accae875 |
| data/ml-polish-00010.parquet | Data | 457.1 MB | 4fbea167865c |
| data/ml-polish-00011.parquet | Data | 531.1 MB | 2831c193d321 |
| data/ml-polish-00012.parquet | Data | 778.9 MB | f7a0c379a5f0 |
| data/ml-portuguese-00000.parquet | Data | 1.0 GB | 34b7a3ddba6c |
| data/ml-portuguese-00001.parquet | Data | 1.1 GB | 893d7299a093 |
| data/ml-portuguese-00002.parquet | Data | 1.1 GB | b709c84db299 |
| data/ml-portuguese-00003.parquet | Data | 1.1 GB | f9c8d9e02ba0 |
| data/ml-russian-00000.parquet | Data | 176.5 MB | 8e6d7f5ed371 |
| data/ml-russian-00001.parquet | Data | 177.2 MB | 636028632ca2 |
| data/ml-russian-00002.parquet | Data | 177.2 MB | 6fe1e4eddf9c |
| data/ml-russian-00003.parquet | Data | 178.1 MB | bc60daae73ae |
| data/ml-russian-00004.parquet | Data | 179.6 MB | 31e1761b8a6f |
| data/ml-russian-00005.parquet | Data | 178.0 MB | 8cf2c7c8ee0e |
| data/ml-russian-00006.parquet | Data | 176.8 MB | 6ab7499d5eff |
| data/ml-russian-00007.parquet | Data | 176.2 MB | 4261114fb4ce |
| data/ml-russian-00008.parquet | Data | 177.6 MB | d503c3f3d959 |
| data/ml-russian-00009.parquet | Data | 178.5 MB | a4ce1c05ebc0 |
| data/ml-russian-00010.parquet | Data | 136.2 MB | 6ad7926978ac |
| data/ml-russian-00011.parquet | Data | 124.8 MB | 0b9bf6cea8d6 |
| data/ml-russian-00012.parquet | Data | 125.4 MB | d671f2493cb1 |
| data/ml-russian-00013.parquet | Data | 126.7 MB | 253f52efd3ae |
| data/ml-russian-00014.parquet | Data | 125.8 MB | a10ab6c0a11f |
| data/ml-russian-00015.parquet | Data | 124.8 MB | e3ca877f7773 |
| data/ml-russian-00016.parquet | Data | 124.2 MB | f634022225b7 |
| data/ml-russian-00017.parquet | Data | 126.2 MB | ea089a03da6e |
| data/ml-russian-00018.parquet | Data | 125.8 MB | 4c19306e6a97 |
| data/ml-russian-00019.parquet | Data | 125.0 MB | bba87b173006 |
| data/ml-russian-00020.parquet | Data | 125.5 MB | 063f72cda5ed |
| data/ml-russian-00021.parquet | Data | 125.4 MB | 69c043f7a23e |
| data/ml-russian-00022.parquet | Data | 126.1 MB | 6ed49841d942 |
| data/ml-russian-00023.parquet | Data | 124.4 MB | c85e55ee2579 |
| data/ml-spanish-00000.parquet | Data | 284.9 MB | 3f9278e79a28 |
| data/ml-spanish-00001.parquet | Data | 289.9 MB | 07e5b188664d |
| data/ml-spanish-00002.parquet | Data | 266.4 MB | 3fad3fcdbc4e |
| data/ml-spanish-00003.parquet | Data | 293.2 MB | c86cfc3bfc45 |
| data/ml-spanish-00004.parquet | Data | 365.9 MB | d3a22bf3053f |
| data/ml-spanish-00005.parquet | Data | 423.6 MB | 9073e1fb5e1f |
| data/ml-spanish-00006.parquet | Data | 424.1 MB | fc2130fd26f5 |
| data/ml-spanish-00007.parquet | Data | 427.8 MB | 741ef4267209 |
| data/ml-spanish-00008.parquet | Data | 427.2 MB | 520c2398093b |
| data/ml-spanish-00009.parquet | Data | 420.0 MB | b7523ca66f22 |
| data/ml-spanish-00010.parquet | Data | 425.0 MB | 669b37333fec |
| data/ml-spanish-00011.parquet | Data | 423.8 MB | f06f281dfaa9 |
| data/ml-spanish-00012.parquet | Data | 424.3 MB | 6a48157c74e1 |
| data/ml-spanish-00013.parquet | Data | 430.2 MB | 9b059b90d81a |
| data/ml-spanish-00014.parquet | Data | 432.7 MB | 89911f15d50e |
| data/ml-spanish-00015.parquet | Data | 441.5 MB | 411b6e80be31 |
| data/ml-spanish-00016.parquet | Data | 439.4 MB | 4979801094c9 |
| data/ml-spanish-00017.parquet | Data | 434.9 MB | 51f7f1b9049c |
| data/ml-spanish-00018.parquet | Data | 442.0 MB | 8fd8d505ec6f |
| data/ml-spanish-00019.parquet | Data | 440.2 MB | 37ed5e71c5de |
| data/ml-spanish-00020.parquet | Data | 437.6 MB | 893d8cab4d0f |
| data/ml-spanish-00021.parquet | Data | 443.0 MB | f82d2d3848cc |
| data/ml-spanish-00022.parquet | Data | 439.9 MB | 1005a4b1cce4 |
| data/ml-spanish-00023.parquet | Data | 432.6 MB | 0239d499de91 |
| data/ml-thai-00000.parquet | Data | 353.0 MB | 40117a4e58a4 |
| data/ml-thai-00001.parquet | Data | 350.9 MB | cafdab791530 |
| data/ml-thai-00002.parquet | Data | 349.9 MB | 48013145ab6b |
| data/ml-thai-00003.parquet | Data | 349.6 MB | d1b5defceaca |
| data/ml-thai-00004.parquet | Data | 352.5 MB | c39aa3748b46 |
| data/ml-thai-00005.parquet | Data | 347.6 MB | 6f97ac2b7eae |
| data/ml-thai-00006.parquet | Data | 352.0 MB | 9605f96b11a7 |
| data/ml-thai-00007.parquet | Data | 352.1 MB | b04025a8e552 |
| data/ml-thai-00008.parquet | Data | 353.3 MB | 0a457f9cc84e |
| data/ml-thai-00009.parquet | Data | 351.3 MB | 86a1cc2a368f |
| data/ml-thai-00010.parquet | Data | 353.1 MB | c86350dc82b9 |
| data/ml-thai-00011.parquet | Data | 355.3 MB | d5baa92533c6 |
| data/ml-thai-00012.parquet | Data | 348.6 MB | 2a6d787ead6b |
| data/ml-thai-00013.parquet | Data | 346.6 MB | 7a4b9ba650d8 |
| data/ml-thai-00014.parquet | Data | 350.3 MB | 573c4ff33705 |
| data/ml-thai-00015.parquet | Data | 352.7 MB | 0a33e2766185 |
| data/ml-thai-00016.parquet | Data | 352.4 MB | 17756bf01a90 |
| data/ml-thai-00017.parquet | Data | 349.4 MB | 711396b5f28a |
| data/ml-thai-00018.parquet | Data | 353.1 MB | 527403fdccd0 |
| data/ml-thai-00019.parquet | Data | 353.3 MB | f2864226264c |
| data/ml-thai-00020.parquet | Data | 350.9 MB | 06b09faa2d05 |
| data/ml-thai-00021.parquet | Data | 343.9 MB | c49819c8d8d9 |
| data/ml-thai-00022.parquet | Data | 289.5 MB | b7c9f0352180 |
| data/ml-thai-00023.parquet | Data | 290.0 MB | 73e96f061e9c |
| data/ml-turkish-00000.parquet | Data | 155.6 MB | 7e58eb722856 |
| data/ml-turkish-00001.parquet | Data | 157.3 MB | cf0fdde8dccc |
| data/ml-turkish-00002.parquet | Data | 155.8 MB | 43a3224f3cce |
| data/ml-turkish-00003.parquet | Data | 156.6 MB | d9729d31019c |
| data/ml-turkish-00004.parquet | Data | 156.0 MB | 1dfba8869977 |
| data/ml-turkish-00005.parquet | Data | 155.7 MB | 990b66673c91 |
| data/ml-turkish-00006.parquet | Data | 156.5 MB | 08c69189d153 |
| data/ml-turkish-00007.parquet | Data | 155.9 MB | 715aed8c24f6 |
| data/ml-turkish-00008.parquet | Data | 156.7 MB | db1d176c93b4 |
| data/ml-turkish-00009.parquet | Data | 154.9 MB | 8fe1655fc966 |
| data/ml-turkish-00010.parquet | Data | 155.2 MB | d1bde1badb03 |
| data/ml-turkish-00011.parquet | Data | 156.5 MB | cc6f56d1b175 |
| data/ml-turkish-00012.parquet | Data | 156.0 MB | 145ddaa7ede2 |
| data/ml-turkish-00013.parquet | Data | 156.1 MB | c81d250e4c8d |
| data/ml-turkish-00014.parquet | Data | 155.5 MB | 131c721da6bd |
| data/ml-turkish-00015.parquet | Data | 155.0 MB | 51ea3be5bb71 |
| data/ml-turkish-00016.parquet | Data | 155.9 MB | ed1d23f5def4 |
| data/ml-turkish-00017.parquet | Data | 156.7 MB | b27d771e4986 |
| data/ml-turkish-00018.parquet | Data | 156.6 MB | 0c774d47abeb |
| data/ml-turkish-00019.parquet | Data | 155.9 MB | 5e198db3eb84 |
| data/ml-turkish-00020.parquet | Data | 155.1 MB | cb626b7ea38e |
| data/ml-turkish-00021.parquet | Data | 157.1 MB | 4e811472f702 |
| data/ml-turkish-00022.parquet | Data | 155.8 MB | f3a60a1b1fa7 |
| data/ml-turkish-00023.parquet | Data | 155.5 MB | dde2d55d8e5c |
| data/ms-dialects-s0-00000.parquet | Data | 262.5 MB | 15059c5bf46d |
| data/ms-dialects-s0-00001.parquet | Data | 265.8 MB | d41d9c439f8a |
| data/ms-dialects-s0-00002.parquet | Data | 261.2 MB | b9f174cd655f |
| data/ms-dialects-s0-00003.parquet | Data | 266.2 MB | 95ffcd770ef3 |
| data/ms-dialects-s0-00004.parquet | Data | 259.9 MB | 9743eff75890 |
| data/ms-dialects-s1-00000.parquet | Data | 265.2 MB | 4cd1ecef0c00 |
| data/ms-dialects-s1-00001.parquet | Data | 266.6 MB | 66e74379cb8f |
| data/ms-dialects-s1-00002.parquet | Data | 263.0 MB | 6d13f75266d2 |
| data/ms-dialects-s1-00003.parquet | Data | 253.9 MB | 3292df471e7b |
| data/ms-dialects-s1-00004.parquet | Data | 257.0 MB | 14bc854d140d |
| data/ms-dialects-s10-00000.parquet | Data | 267.5 MB | ae2e7a508e67 |
| data/ms-dialects-s10-00001.parquet | Data | 260.3 MB | 47085c69e2b3 |
| data/ms-dialects-s10-00002.parquet | Data | 260.5 MB | 83066122c2fa |
| data/ms-dialects-s10-00003.parquet | Data | 266.9 MB | 7ddcb4958dd8 |
| data/ms-dialects-s10-00004.parquet | Data | 267.1 MB | e46c6db938d1 |
| data/ms-dialects-s11-00000.parquet | Data | 262.0 MB | 1076fb915ef1 |
| data/ms-dialects-s11-00001.parquet | Data | 265.6 MB | 78854e6d12a8 |
| data/ms-dialects-s11-00002.parquet | Data | 263.5 MB | 543928a18bb9 |
| data/ms-dialects-s11-00003.parquet | Data | 258.9 MB | fc0eac5734a8 |
| data/ms-dialects-s11-00004.parquet | Data | 263.8 MB | 800ca967d74e |
| data/ms-dialects-s12-00000.parquet | Data | 256.2 MB | 550508b166b1 |
| data/ms-dialects-s12-00001.parquet | Data | 261.0 MB | 7848d3e24c59 |
| data/ms-dialects-s12-00002.parquet | Data | 252.8 MB | d57772a47e33 |
| data/ms-dialects-s12-00003.parquet | Data | 266.5 MB | 7792015bbd19 |
| data/ms-dialects-s12-00004.parquet | Data | 260.8 MB | f1c2b217a73e |
| data/ms-dialects-s13-00000.parquet | Data | 255.6 MB | 86875bf79752 |
| data/ms-dialects-s13-00001.parquet | Data | 264.9 MB | 5f5b4776030f |
| data/ms-dialects-s13-00002.parquet | Data | 270.4 MB | 85b986419da9 |
| data/ms-dialects-s13-00003.parquet | Data | 261.0 MB | ed722643b79d |
| data/ms-dialects-s13-00004.parquet | Data | 257.9 MB | 2239c221693b |
| data/ms-dialects-s14-00000.parquet | Data | 265.5 MB | 88d4dd1008f3 |
| data/ms-dialects-s14-00001.parquet | Data | 264.7 MB | 3a3b1d0eb944 |
| data/ms-dialects-s14-00002.parquet | Data | 264.7 MB | 41e19fcbb9b0 |
| data/ms-dialects-s14-00003.parquet | Data | 263.1 MB | 883ee80df9ca |
| data/ms-dialects-s14-00004.parquet | Data | 256.6 MB | 91989b6a03c7 |
| data/ms-dialects-s15-00000.parquet | Data | 262.4 MB | 5d1d6c3db28c |
| data/ms-dialects-s15-00001.parquet | Data | 262.8 MB | 507f2932b7a2 |
| data/ms-dialects-s15-00002.parquet | Data | 265.1 MB | 989301b4c37e |
| data/ms-dialects-s15-00003.parquet | Data | 267.1 MB | 969774e8e2a3 |
| data/ms-dialects-s15-00004.parquet | Data | 267.5 MB | 03d25f2b4c78 |
| data/ms-dialects-s16-00000.parquet | Data | 264.8 MB | a6b093d2c421 |
| data/ms-dialects-s16-00001.parquet | Data | 260.5 MB | 3291521c0450 |
| data/ms-dialects-s16-00002.parquet | Data | 269.1 MB | 4e3c96c398a6 |
| data/ms-dialects-s16-00003.parquet | Data | 262.2 MB | 2a05fea32b78 |
| data/ms-dialects-s16-00004.parquet | Data | 265.1 MB | 8af2400ba722 |
| data/ms-dialects-s17-00000.parquet | Data | 264.8 MB | 90e16277b0d2 |
| data/ms-dialects-s17-00001.parquet | Data | 262.8 MB | 501d74c6e842 |
| data/ms-dialects-s17-00002.parquet | Data | 259.0 MB | f0bd34855a14 |
| data/ms-dialects-s17-00003.parquet | Data | 263.6 MB | 4607f770dd76 |
| data/ms-dialects-s17-00004.parquet | Data | 267.9 MB | da8ef086779a |
| data/ms-dialects-s2-00000.parquet | Data | 269.3 MB | 4bcb22b3c1ac |
| data/ms-dialects-s2-00001.parquet | Data | 263.0 MB | 3944f138ecea |
| data/ms-dialects-s2-00002.parquet | Data | 267.4 MB | 07a7e214080f |
| data/ms-dialects-s2-00003.parquet | Data | 268.0 MB | 12c3b0cc8746 |
| data/ms-dialects-s2-00004.parquet | Data | 255.7 MB | ba4cfe3b05a6 |
| data/ms-dialects-s3-00000.parquet | Data | 262.0 MB | 80fd934eef31 |
| data/ms-dialects-s3-00001.parquet | Data | 260.6 MB | 532333602f30 |
| data/ms-dialects-s3-00002.parquet | Data | 257.2 MB | 95cd6b0c53d1 |
| data/ms-dialects-s3-00003.parquet | Data | 255.3 MB | 5b6570683012 |
| data/ms-dialects-s3-00004.parquet | Data | 259.0 MB | 8cb3c985c2e0 |
| data/ms-dialects-s4-00000.parquet | Data | 261.7 MB | 64a2be4341aa |
| data/ms-dialects-s4-00001.parquet | Data | 257.1 MB | 953b7a0962de |
| data/ms-dialects-s4-00002.parquet | Data | 267.6 MB | 73ae8deba88f |
| data/ms-dialects-s4-00003.parquet | Data | 261.1 MB | abf7cd4a0d26 |
| data/ms-dialects-s4-00004.parquet | Data | 257.4 MB | 2bc807f661ab |
| data/ms-dialects-s5-00000.parquet | Data | 262.5 MB | 063672facf8f |
| data/ms-dialects-s5-00001.parquet | Data | 260.1 MB | 9957937d8adc |
| data/ms-dialects-s5-00002.parquet | Data | 268.4 MB | 5ae4e8b0d50f |
| data/ms-dialects-s5-00003.parquet | Data | 261.0 MB | 427a0f209a66 |
| data/ms-dialects-s5-00004.parquet | Data | 262.6 MB | fb36f2fc51da |
| data/ms-dialects-s6-00000.parquet | Data | 264.5 MB | 8bab789ad59b |
| data/ms-dialects-s6-00001.parquet | Data | 262.3 MB | b3b2fc742e69 |
| data/ms-dialects-s6-00002.parquet | Data | 255.6 MB | 21551316253c |
| data/ms-dialects-s6-00003.parquet | Data | 270.9 MB | 03ac3aa1ce26 |
| data/ms-dialects-s6-00004.parquet | Data | 269.2 MB | abe0cb1c68de |
| data/ms-dialects-s7-00000.parquet | Data | 261.0 MB | 8c92c6237292 |
| data/ms-dialects-s7-00001.parquet | Data | 263.9 MB | 5c16cd52a34a |
| data/ms-dialects-s7-00002.parquet | Data | 257.0 MB | dbbac23bbe90 |
| data/ms-dialects-s7-00003.parquet | Data | 264.5 MB | a2c881cbcc60 |
| data/ms-dialects-s7-00004.parquet | Data | 259.8 MB | 44807ef94b74 |
| data/ms-dialects-s8-00000.parquet | Data | 266.9 MB | e6ed4c7142ed |
| data/ms-dialects-s8-00001.parquet | Data | 257.2 MB | 7f8988ed2fb3 |
| data/ms-dialects-s8-00002.parquet | Data | 264.8 MB | 2c39b1fd3668 |
| data/ms-dialects-s8-00003.parquet | Data | 268.1 MB | 5bf1f1af649d |
| data/ms-dialects-s8-00004.parquet | Data | 262.8 MB | 3d1529ed6425 |
| data/ms-dialects-s9-00000.parquet | Data | 259.2 MB | 1e45b8774ab9 |
| data/ms-dialects-s9-00001.parquet | Data | 264.6 MB | e62bbb66e9e3 |
| data/ms-dialects-s9-00002.parquet | Data | 260.3 MB | 6e37a9bb24cd |
| data/ms-dialects-s9-00003.parquet | Data | 265.3 MB | f91bfcf42f07 |
| data/ms-imda-s0-00000.parquet | Data | 29.6 MB | 17df942e401b |
| data/ms-imda-s1-00000.parquet | Data | 23.1 MB | 1efe1de4a6a9 |
| data/ms-imda-s2-00000.parquet | Data | 228.8 MB | 257aa32ba980 |
| data/ms-imda-s2-00001.parquet | Data | 233.1 MB | 3474edc139bb |
| data/ms-imda-s2-00002.parquet | Data | 252.1 MB | b76e43779054 |
| data/ms-imda-s3-00000.parquet | Data | 386.0 MB | a7a7c8416013 |
| data/ms-imda-s3-00001.parquet | Data | 378.9 MB | 756bba7b2c25 |
| data/ms-imda-s3-00002.parquet | Data | 356.2 MB | ca5ec171b880 |
| data/ms-imda-s4-00000.parquet | Data | 365.3 MB | 9ca2f3f6f757 |
| data/ms-imda-s4-00001.parquet | Data | 351.6 MB | dc74819a724a |
| data/ms-imda-s4-00002.parquet | Data | 348.9 MB | 1e8f8d1a08d0 |
| data/ms-imda-s5-00000.parquet | Data | 273.9 MB | fa5377e567c7 |
| data/ms-imda-s5-00001.parquet | Data | 331.2 MB | 5b022c1fc391 |
| data/ms-imda-s5-00002.parquet | Data | 377.2 MB | b180c3688840 |
| data/ms-imda-s6-00000.parquet | Data | 202.1 MB | 2509c3ecb6ff |
| data/ms-imda-s7-00000.parquet | Data | 281.9 MB | f504fdec44bf |
| data/ms-imda-s7-00001.parquet | Data | 401.2 MB | f83570583fab |
| data/ms-malaysian-s0-00000.parquet | Data | 458.2 MB | 47956fb6e3fa |
| data/ms-malaysian-s0-00001.parquet | Data | 445.2 MB | 001c0dc6afaa |
| data/ms-malaysian-s0-00002.parquet | Data | 464.7 MB | 04c03fc873d9 |
| data/ms-malaysian-s0-00003.parquet | Data | 457.6 MB | 2c8e871aa093 |
| data/ms-malaysian-s0-00004.parquet | Data | 443.6 MB | 13b1afa7f48f |
| data/ms-malaysian-s1-00000.parquet | Data | 443.4 MB | f5506b2478e1 |
| data/ms-malaysian-s1-00001.parquet | Data | 442.4 MB | 7888ee2695f2 |
| data/ms-malaysian-s1-00002.parquet | Data | 438.9 MB | b3068336db19 |
| data/ms-malaysian-s1-00003.parquet | Data | 457.0 MB | 0ad272791dcc |
| data/ms-malaysian-s1-00004.parquet | Data | 453.2 MB | 0a663d6792a7 |
| data/ms-malaysian-s2-00000.parquet | Data | 458.4 MB | 826a7d9da922 |
| data/ms-malaysian-s2-00001.parquet | Data | 448.9 MB | f25fde32930a |
| data/ms-malaysian-s2-00002.parquet | Data | 450.5 MB | fda941a07178 |
| data/ms-malaysian-s2-00003.parquet | Data | 435.8 MB | 51aedfeccb0a |
| data/ms-malaysian-s2-00004.parquet | Data | 433.9 MB | c97f2053c032 |
| data/ms-malaysian-s3-00000.parquet | Data | 429.7 MB | 8de1b5032cc4 |
| data/ms-malaysian-s3-00001.parquet | Data | 440.0 MB | 0d8475edbb3f |
| data/ms-malaysian-s3-00002.parquet | Data | 435.8 MB | 7632f8dd6e69 |
| data/ms-malaysian-s3-00003.parquet | Data | 436.3 MB | 105b5a9d552e |
| data/ms-parliament-s0-00000.parquet | Data | 502.6 MB | a11de9b4d6a0 |
| data/ms-parliament-s0-00001.parquet | Data | 493.0 MB | a6e4f9c4d47e |
| data/ms-science_english-s0-00000.parquet | Data | 399.9 MB | 44a4dac7c942 |
| data/ms-science_english-s0-00001.parquet | Data | 382.1 MB | adf33e7fc336 |
| data/ms-science_english-s0-00002.parquet | Data | 367.8 MB | 347f250bd827 |
| data/ms-science_english-s0-00003.parquet | Data | 400.6 MB | 5249347229a0 |
| data/ms-science_english-s0-00004.parquet | Data | 392.2 MB | ce4e6ae5016d |
| data/ms-science_english-s1-00000.parquet | Data | 408.3 MB | 79c7548e3f82 |
| data/ms-science_english-s1-00001.parquet | Data | 373.8 MB | a8c5811f37b1 |
| data/ms-science_english-s1-00002.parquet | Data | 389.4 MB | 0c13d71c2b8a |
| data/ms-science_english-s1-00003.parquet | Data | 387.9 MB | 05956b23835c |
| data/ms-science_english-s1-00004.parquet | Data | 372.9 MB | 53ab7821bd4f |
| data/ms-science_english-s2-00000.parquet | Data | 394.2 MB | 8a0f50ac1dcc |
| data/ms-science_english-s2-00001.parquet | Data | 445.2 MB | 2fcfd0873eb7 |
| data/ms-science_english-s2-00002.parquet | Data | 386.8 MB | d5214086cea3 |
| data/ms-science_english-s2-00003.parquet | Data | 382.3 MB | 4b888106f387 |
| data/ms-science_english-s2-00004.parquet | Data | 381.5 MB | 3706163feac2 |
| data/ms-science_english-s3-00000.parquet | Data | 386.3 MB | 9bb78018783f |
| data/ms-science_english-s3-00001.parquet | Data | 395.5 MB | 39e9f9c3e316 |
| data/ms-science_english-s3-00002.parquet | Data | 374.1 MB | fac61870738c |
| data/ms-science_english-s3-00003.parquet | Data | 363.3 MB | 4df2243bf263 |
| data/ms-science_english-s3-00004.parquet | Data | 399.5 MB | ffc13e5e8491 |
| data/ms-science_english-s4-00000.parquet | Data | 376.9 MB | db16ad2ea558 |
| data/ms-science_english-s4-00001.parquet | Data | 409.0 MB | c20f53efbbd6 |
| data/ms-science_english-s4-00002.parquet | Data | 374.0 MB | 624bbfdea9b3 |
| data/ms-science_english-s4-00003.parquet | Data | 398.8 MB | ee73c2affd05 |
| data/ms-science_english-s4-00004.parquet | Data | 383.9 MB | 5201e35841c0 |
| data/ms-science_english-s5-00000.parquet | Data | 407.8 MB | f00383004fa7 |
| data/ms-science_english-s5-00001.parquet | Data | 386.0 MB | f9bbf25ac00d |
| data/ms-science_english-s5-00002.parquet | Data | 421.7 MB | f2531850f1bc |
| data/ms-science_english-s5-00003.parquet | Data | 383.7 MB | 6a24abc84470 |
| data/ms-science_english-s5-00004.parquet | Data | 375.6 MB | 01e9b6f8470e |
| data/ms-science_english-s6-00000.parquet | Data | 382.6 MB | 7f40700be286 |
| data/ms-science_english-s6-00001.parquet | Data | 414.4 MB | d46001266e8e |
| data/ms-science_english-s6-00002.parquet | Data | 381.2 MB | b745e7b2eddf |
| data/ms-science_english-s6-00003.parquet | Data | 407.2 MB | 0556e07f1b3d |
| data/test/ml-english-00024.parquet | Data | 82.4 MB | ba728b69510d |
| data/test/ml-french-00024.parquet | Data | 173.5 MB | 2b641d502f63 |
| data/test/ml-german-00024.parquet | Data | 95.7 MB | a37f7c041f95 |
| data/test/ml-italian-00024.parquet | Data | 283.5 MB | 229ed4056ba5 |
| data/test/ml-japanese-00024.parquet | Data | 73.1 MB | 43f2ef6095fc |
| data/test/ml-korean-00024.parquet | Data | 60.1 MB | e91ec574f931 |
| data/test/ml-mandarin-00024.parquet | Data | 26.0 MB | 0c7bfdf51985 |
| data/test/ml-polish-00013.parquet | Data | 183.4 MB | dd7e3e3b601f |
| data/test/ml-portuguese-00004.parquet | Data | 80.1 MB | 470d32b72081 |
| data/test/ml-russian-00024.parquet | Data | 42.3 MB | e0bde891d9e4 |
| data/test/ml-spanish-00024.parquet | Data | 108.6 MB | 3fbc9fc582e7 |
| data/test/ml-thai-00024.parquet | Data | 72.2 MB | 9163b4dde7b1 |
| data/test/ml-turkish-00024.parquet | Data | 38.8 MB | 4327da4c3cc4 |
| data/test/ms-dialects-s9-00004.parquet | Data | 66.8 MB | 943feefbe11a |
| data/test/ms-imda-s7-00002.parquet | Data | 105.1 MB | fd920689f46f |
| data/test/ms-malaysian-s3-00004.parquet | Data | 110.8 MB | 04581b047d02 |
| data/test/ms-parliament-s0-00002.parquet | Data | 134.5 MB | c47620c6e36f |
| data/test/ms-science_english-s6-00004.parquet | Data | 107.5 MB | 628f714a13e7 |
| data/train/ml-english-00024.parquet | Data | 166.9 MB | 619df14c7cec |
| data/train/ml-french-00024.parquet | Data | 345.6 MB | efa62c9cc2f6 |
| data/train/ml-german-00024.parquet | Data | 192.0 MB | 0817c90b0dcf |
| data/train/ml-italian-00024.parquet | Data | 566.5 MB | 2a566b97c177 |
| data/train/ml-japanese-00024.parquet | Data | 145.1 MB | 24e8964e508e |
| data/train/ml-korean-00024.parquet | Data | 122.9 MB | 56f4427d2582 |
| data/train/ml-mandarin-00024.parquet | Data | 51.7 MB | 82c6ad981fe0 |
| data/train/ml-polish-00013.parquet | Data | 364.8 MB | 3087caa17c5b |
| data/train/ml-portuguese-00004.parquet | Data | 165.0 MB | 4a9315b867da |
| data/train/ml-russian-00024.parquet | Data | 85.0 MB | 1f498f6bff30 |
| data/train/ml-spanish-00024.parquet | Data | 219.0 MB | 4415613168fe |
| data/train/ml-thai-00024.parquet | Data | 144.9 MB | 073f848e84e7 |
| data/train/ml-turkish-00024.parquet | Data | 78.1 MB | 21fed403237a |
| data/train/ms-dialects-s9-00004.parquet | Data | 132.3 MB | 09237704b400 |
| data/train/ms-imda-s7-00002.parquet | Data | 207.2 MB | 8245b4c45f20 |
| data/train/ms-malaysian-s3-00004.parquet | Data | 220.7 MB | a976f54ecb17 |
| data/train/ms-parliament-s0-00002.parquet | Data | 260.8 MB | 633a26691104 |
| data/train/ms-science_english-s6-00004.parquet | Data | 210.9 MB | e1231ee7eb69 |
| data/validation/ml-english-00024.parquet | Data | 83.1 MB | 522b66f6ed9c |
| data/validation/ml-french-00024.parquet | Data | 172.4 MB | 3bdb4d8db745 |
| data/validation/ml-german-00024.parquet | Data | 95.3 MB | 76a492d36fe4 |
| data/validation/ml-italian-00024.parquet | Data | 282.9 MB | c9fb0bd5e699 |
| data/validation/ml-japanese-00024.parquet | Data | 74.8 MB | ffb63cf97ba5 |
| data/validation/ml-korean-00024.parquet | Data | 62.6 MB | 7ec6e05a07e6 |
| data/validation/ml-mandarin-00024.parquet | Data | 25.8 MB | 761270a8a6a5 |
| data/validation/ml-polish-00013.parquet | Data | 183.1 MB | 1237743628b9 |
| data/validation/ml-portuguese-00004.parquet | Data | 79.5 MB | d4294c1629f7 |
| data/validation/ml-russian-00024.parquet | Data | 42.4 MB | 599899b0c8cb |
| data/validation/ml-spanish-00024.parquet | Data | 109.2 MB | 238b79b2f44d |
| data/validation/ml-thai-00024.parquet | Data | 71.9 MB | 28d700d4143b |
| data/validation/ml-turkish-00024.parquet | Data | 37.9 MB | c72132b985cb |
| data/validation/ms-dialects-s9-00004.parquet | Data | 68.2 MB | 0b7aef78e48e |
| data/validation/ms-imda-s7-00002.parquet | Data | 101.8 MB | b9d2ead8693e |
| data/validation/ms-malaysian-s3-00004.parquet | Data | 110.6 MB | fef41f4e90f7 |
| data/validation/ms-parliament-s0-00002.parquet | Data | 131.8 MB | 68a5c7cb77e4 |
| data/validation/ms-science_english-s6-00004.parquet | Data | 104.4 MB | 250acbeb8427 |
| README.md | Documentation | 6.5 KB | — |
| .gitattributes | Repository | 2.5 KB | — |
License and Download
- License
- cc-by-4.0
- Access
- No access gate
Download from Scicom (MSC) BHD
Released by Scicom (MSC) BHD through its official repository on Hugging Face. Read the license.