Dataset
all_the_news_2_pythia_tfidf_topic_stratified_v1_articles
by National Engineering Research Center for Big Data Software THULab/all_the_news_2_pythia_tfidf_topic_stratified_v1_articles
Apache TsFile version of MA-tokenweights/all-the-news-2-pythia-tfidf-topic-stratified-v1-articles. The articles/text table of the MA-tokenweights All the News 2 Pythia TF-IDF topic-stratified pipeline.
Dataset Card
Apache TsFile version of MA-tokenweights/all-the-news-2-pythia-tfidf-topic-stratified-v1-articles. The articles/text table of the MA-tokenweights All the News 2 Pythia TF-IDF topic-stratified pipeline. Each record is one news article drawn from the All the News 2 corpus: its full body text, word/token counts and line spans, plus bibliographic metadata (title, publication, date, URL, section). The corpus was tokenized with the Pythia tokenizer and weighted with TF-IDF, topic-stratified, and split into trainarticles and validationarticles. (163,380 articles in total). (metatitle, metapublication, metadate, metaurl, metasection,...). articles came from the original training split); the two…
Excerpt from the card by National Engineering Research Center for Big Data Software.
Details
- Repository
- THULab/all_the_news_2_pythia_tfidf_topic_stratified_v1_articles
- Publisher
- National Engineering Research Center for Big Data Software
- Task category
- Not stated by the source
- Tags
- tsfile, timeseries, format:tsfile
- Size category
- 100K<n<1M
- Languages
- nlp
- Revision
- c4d9c2971eaef54b62ba7235d137dac66b5a5795
- Last updated
- 2026-09-23
Files
4 files, 387.9 MB in total.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| README.md | Documentation | 4.1 KB | — |
| train_articles.tsfile | Other | 382.1 MB | 8efe59931f4d |
| validation_articles.tsfile | Other | 5.8 MB | fb63d1952009 |
| .gitattributes | Repository | 2.6 KB | — |
License and Download
- License
- Not stated by the source
- Access
- No access gate
Released by National Engineering Research Center for Big Data Software through its official repository on Hugging Face.