SAVRN
Search Contact SAVRN

Open-weight model

waldito-smoke-v1-r0002-merge

by Michael D'Agosta mdagosta/waldito-smoke-v1-r0002-merge

waldito-smoke-v1-r0002-merge is an open-weight model from Michael D'Agosta. It has 820,736 parameters and a 512-token context. At 16-bit it needs about 0 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

Parameters820,736
Context512
Weights1.6 MB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve waldito-smoke-v1-r0002-merge (820,736 parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 7, 2026.

waldito-smoke-v1-r0002-merge on every accelerator the SAVRN Index prices, at every precision

Model Card

The publisher has not written a card for this model.

Configuration

Architecture
LlamaForCausalLM
Context length (tokens)
512
Layers
4
Hidden size
128
Feed-forward size
384
Attention heads
4
Key/value heads
2
Vocabulary size
259
RoPE base
10,000
Stored precision
bfloat16
Model type
llama

Identity and Version

Repository
mdagosta/waldito-smoke-v1-r0002-merge
Publisher
Michael D'Agosta
Task
Not stated by the source
Modality
Other
Library
Not stated by the source
Parameters
820,736 parameters
Languages
Not stated by the source
Revision
31e1761d602b52e35c112e31bef7e5e2ab613ee1
First published
2026-09-30
Last updated
2026-09-30

Files and Weights

10 files, 1.7 MB in total. The weights are 1 file totalling 1.6 MB in safetensors.

Weights1 file · 1.6 MB
Configuration6 files · 3.6 KB
Tokenizer1 file · 712 B
Other1 file · 381 B
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.6 MB c5fae5413538
BOM.jsonConfiguration911 B —
architecture.pyConfiguration203 B —
config.jsonConfiguration458 B —
generation_config.jsonConfiguration79 B —
special_tokens_map.jsonConfiguration62 B —
tokenization_openwaldo.pyConfiguration1.9 KB —
chat_template.jinjaOther381 B —
.gitattributesRepository1.5 KB —
tokenizer_config.jsonTokenizer712 B —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
1.6 MB
Download from Michael D'Agosta

Released by Michael D'Agosta through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published1.6 MB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About waldito-smoke-v1-r0002-merge

How much GPU memory does waldito-smoke-v1-r0002-merge need?

About 0 GB at 16-bit and 0 GB at 4-bit: the weights (820,736 parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run waldito-smoke-v1-r0002-merge on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is waldito-smoke-v1-r0002-merge's context length?

512 tokens, from the maximum position embeddings in its published configuration.