Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text classification

gpt2-small-ag-news

by Rahul Iyer rahuliyer/gpt2-small-ag-news

gpt2-small-ag-news is an open-weight model for text classification from Rahul Iyer. Its published files total 2.0 GB.

The released GPT-2 small weights fine-tuned to classify AG News articles into four topics: World, Sports, Business and Sci/Tech. Four setups compare how much of the model needs to train.

Parameters—
Context—
Weights2.0 GB
License—
AccessOpen weights
Monthly Downloads—

Model Card

The released GPT-2 small weights fine-tuned to classify AG News articles into four topics: World, Sports, Business and Sci/Tech. Four setups compare how much of the model needs to train. Training details and plots: Each setup trained for 3 epochs on one RTX 2080. Test numbers come from the checkpoint with the lowest validation loss. Each folder holds best.safetensors and its training config.json. logs/ has the training output of each run. These weights use the GPT2 class from gpt2-repro, not Hugging Face Transformers. Clone gpt2-repro and install its dependencies with uv, then run the code below from the repository The classifier reads the logits at each input's last real token. Inputs were…

Excerpt from the card by Rahul Iyer.

Identity and Version

Repository
rahuliyer/gpt2-small-ag-news
Publisher
Rahul Iyer
Task
Text classification
Modality
Text
Library
pytorch
Parameters
Not stated by the source
Languages
en
Revision
90bafd7c14d63f911b441c8b2b8a341a9c17ca22
First published
2026-10-06
Last updated
2026-10-06

Files and Weights

14 files, 2.0 GB in total. The weights are 4 files totalling 2.0 GB in safetensors.

Weights4 files · 2.0 GB
Configuration4 files · 1.9 KB
Documentation1 file · 2.9 KB
Other4 files · 64.4 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
linear_head_full_20261001_174018/best.safetensorsWeights497.8 MB bcb6f0f96ea8
linear_head_last_block_20261001_182749/best.safetensorsWeights497.8 MB 0b84051a8960
mlp_head_20261001_174018/best.safetensorsWeights507.3 MB d81de014a215
mlp_head_last_block_20261001_180053/best.safetensorsWeights507.3 MB 6d18287634d9
linear_head_full_20261001_174018/config.jsonConfiguration466 B —
linear_head_last_block_20261001_182749/config.jsonConfiguration480 B —
mlp_head_20261001_174018/config.jsonConfiguration455 B —
mlp_head_last_block_20261001_180053/config.jsonConfiguration474 B —
README.mdDocumentation2.9 KB —
logs/train_linear_head_full.logOther23.9 KB —
logs/train_linear_head_last_block.logOther15.8 KB —
logs/train_mlp_head.logOther9.0 KB —
logs/train_mlp_head_last_block.logOther15.7 KB —
.gitattributesRepository1.5 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
2.0 GB
Download from Rahul Iyer

Released by Rahul Iyer through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published2.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Similar Models

Model · Text classification

twitter-roberta-base-sentiment-latest

Cardiff NLP

This is a RoBERTa-base model trained on ~124M tweets from January 2018 to December 2021, and finetuned for sentiment analysis with the TweetEval benchmark. The original Twitter-based RoBERTa model can be found here and the original reference paper is TweetEval. This model is suitable for English. 0 -> Negative; 1 -> Neutral; 2 -> Positive This sentiment analysis model has been integrated into TweetNLP. You can access the demo here.

Open weights cc-by-4.0 514 tokens transformers

Model · Text classification

finbert-tone

Yi

FinBERT is a BERT model pre-trained on financial communication text. The purpose is to enhance financial NLP research and practice. It is trained on the following three financial communication corpus. The total corpora size is 4.9B tokens. More technical details on FinBERT: Click Link This released finbert-tone model is the FinBERT model fine-tuned on 10,000 manually annotated (positive, negative, neutral) sentences from analyst reports. This model achieves superior performance on financial tone analysis task. If you are simply interested in using FinBERT for financial tone analysis, give it a try. If you use the model in your academic work, please cite the following paper: Huang, Allen H.…

Open weights 512 tokens transformers

Model · Text classification

ms-marco-MiniLM-L-6-v2

Joshua

https://huggingface.co/cross-encoder/ms-marco-MiniLM-L-6-v2 with ONNX weights to be compatible with Transformers.js. If you haven't already, you can install the Transformers.js JavaScript library from NPM using: Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).

Open weights 512 tokens transformers.js

Model · Text classification

twitter-xlm-roberta-base-sentiment

Cardiff NLP

This is a multilingual XLM-roBERTa-base model trained on ~198M tweets and finetuned for sentiment analysis. The sentiment fine-tuning was done on 8 languages (Ar, En, Fr, De, Hi, It, Sp, Pt) but it can be used for more languages (see paper for details). This model has been integrated into the TweetNLP library.

Open weights 514 tokens transformers

Model · Text classification

unbiased-toxic-roberta

Unitary

The huggingface models currently give different results to the detoxify library (see issue here). For the most up to date models we recommend using the models from https://github.com/unitaryai/detoxify Trained models & code to predict toxic comments on 3 Jigsaw challenges: Toxic comment classification, Unintended Bias in Toxic comments, Multilingual toxic comment classification. Built by Laura Hanu at Unitary, where we are working to stop harmful content online by interpreting visual content in context. Score not directly comparable since it is obtained on the validation set provided and not on the test set. To update when the test labels are made available. It is also noteworthy to mention…

Open weights apache-2.0 514 tokens transformers

Model · Text classification

emotion-english-distilroberta-base

Hartmann

With this model, you can classify emotions in English text data. The model was trained on 6 diverse datasets (see Appendix below) and predicts Ekman's 6 basic emotions, plus a neutral class: 1) anger 2) disgust 3) fear 4) joy 5) neutral 6) sadness 7) surprise The model is a fine-tuned checkpoint of DistilRoBERTa-base. For a 'non-distilled' emotion model, please refer to the model card of the RoBERTa-large version. a) Run emotion model with 3 lines of code on single text example using Hugging Face's pipeline command on Google Colab: b) Run emotion model on multiple examples and full datasets (e.g.,.csv files) on Google Colab: Please reach out to [email protected] if you have any…

Open weights 514 tokens transformers