Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text classification

dummy

by Yuki Takazawa yukiregista/dummy

dummy is an open-weight model for text classification from Yuki Takazawa. It has 108M parameters and a 512-token context. At 16-bit it needs about 0.3 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 2e-05 - trainbatchsize: 8 - evalbatchsize: 8 - lrschedulertype: linear…

Parameters108M
Context512
Weights433.3 MB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve dummy (108M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.2 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

dummy on every accelerator the SAVRN Index prices, at every precision

Model Card

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 2e-05 - trainbatchsize: 8 - evalbatchsize: 8 - lrschedulertype: linear - numepochs: 3 - Transformers 5.16.1 - Pytorch 2.11.0+cpu - Datasets 4.8.5 - Tokenizers 0.23.1

Excerpt from the card by Yuki Takazawa.

Configuration

Architecture
BertForSequenceClassification
Context length (tokens)
512
Layers
12
Hidden size
768
Feed-forward size
3,072
Attention heads
12
Vocabulary size
28,996
Model type
bert

Identity and Version

Repository
yukiregista/dummy
Publisher
Yuki Takazawa
Task
Text classification
Modality
Text
Library
transformers
Parameters
108M parameters
Languages
Not stated by the source
Revision
f9c216c4ccb2dc325788ccd4953ba471efcf39fd
First published
2026-09-22
Last updated
2026-09-23

Files and Weights

8 files, 434.0 MB in total. The weights are 2 files totalling 433.3 MB in bin, safetensors.

Weights2 files · 433.3 MB
Configuration2 files · 3.8 KB
Tokenizer2 files · 669.5 KB
Documentation1 file · 1.5 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights433.3 MB 2e075f33ea6f
training_args.binWeights5.3 KB d7507bf17283
config.jsonConfiguration948 B —
trainer_state.jsonConfiguration2.9 KB —
README.mdDocumentation1.5 KB —
.gitattributesRepository1.5 KB —
tokenizer.jsonTokenizer669.0 KB —
tokenizer_config.jsonTokenizer459 B —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
433.3 MB
Download from Yuki Takazawa

Released by Yuki Takazawa through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published433.3 MB
16-bit0.2 GB
8-bit0.1 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About dummy

How much GPU memory does dummy need?

About 0.3 GB at 16-bit and 0.1 GB at 4-bit: the weights (108M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run dummy on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is dummy's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text classification

robertuito-sentiment-analysis

Pysentimiento

Model trained with TASS 2020 corpus (around ~5k tweets) of several dialects of Spanish. Base model is RoBERTuito, a RoBERTa model trained in Spanish tweets. Uses POS, NEG, NEU labels. Use it directly with pysentimiento Results for the four tasks evaluated in pysentimiento. Results are expressed as Macro F1 scores Note that for Hate Speech, these are the results for Semeval 2019, Task 5 Subtask B If you use this model in your research, please cite pysentimiento, RoBERTuito and TASS papers

Open weights 109M parameters 130 tokens pysentimiento

Model · Text classification

bert-log-anomaly-detection

Aungruk Vanichanai

1. bert-log-anomaly-detection is a BERT-based NLP model fine-tuned for single SQL transaction log anomaly detection. 2. The model classifies each database transaction log as either Normal or Anomaly, with the goal of supporting AI-powered fraud detection and cybersecurity monitoring systems. 3. This model was developed as part of the Samsung × KBTG Digital Fraud Cybersecurity Hackathon (Thailand) under the AI-Powered Fraud Detection & Prevention track. This model analyzes individual SQL database transaction logs and detects abnormal patterns that may indicate fraudulent, malicious, or suspicious behavior. - Developed by Waris Sripatoomrak, this model integrates with an n8n workflow to…

Open weights apache-2.0 109M parameters 512 tokens transformers

This model is a fine-tuned version of google/electra-base-discriminator on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 2e-05 - trainbatchsize: 8 - evalbatchsize: 8 - gradientaccumulationsteps: 2 - totaltrainbatchsize: 16 - lrschedulertype: linear - lrschedulerwarmupsteps: 50 - numepochs: 10 - Transformers 5.2.0 - Pytorch 2.10.0+cu128 - Datasets 4.5.0 - Tokenizers 0.22.2

Open weights apache-2.0 109M parameters 512 tokens transformers

Model · Text classification

counterbench-bert-base-uncased

Arnav Verma

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 2e-05 - trainbatchsize: 16 - evalbatchsize: 32 - lrschedulertype: linear - lrschedulerwarmupsteps: 100 - numepochs: 5 - Transformers 5.17.0 - Pytorch 2.14.0+cu130 - Datasets 3.6.0 - Tokenizers 0.23.2

Open weights apache-2.0 109M parameters 512 tokens transformers

Model · Text classification

multi-domain-sentiment-bert

ADITYA GUPTA

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Open weights 109M parameters 512 tokens transformers

Model · Text classification

assign5autotrain

Harsha B Setty

libraryname: transformers - autotrain - text-classification basemodel: google-bert/bert-base-uncased f1macro: 0.7533020080884588 f1micro: 0.7533333333333333 f1weighted: 0.7533020080884587 precisionmacro: 0.7551310982162045 precisionmicro: 0.7533333333333333 precisionweighted: 0.7551310982162046 recallmacro: 0.7533333333333333 recallmicro: 0.7533333333333333 recallweighted: 0.7533333333333333

Open weights 109M parameters 512 tokens transformers