SAVRN
Search Contact SAVRN

Open-weight model · Text generation

waldito-smoke-v1-r0001-merge

by Michael D'Agosta mdagosta/waldito-smoke-v1-r0001-merge

waldito-smoke-v1-r0001-merge is an open-weight model for text generation from Michael D'Agosta. It has 820,736 parameters and a 512-token context. At 16-bit it needs about 0 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This package uses the standard Transformers Llama causal-language-model architecture with OpenWALDO's schema-1 byte tokenizer. Load the tokenizer with trustremotecode=True.

Parameters820,736
Context512
Weights1.6 MB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve waldito-smoke-v1-r0001-merge (820,736 parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 7, 2026.

waldito-smoke-v1-r0001-merge on every accelerator the SAVRN Index prices, at every precision

Model Card

This package uses the standard Transformers Llama causal-language-model architecture with OpenWALDO's schema-1 byte tokenizer. Load the tokenizer with trustremotecode=True. BOM.json inventories every release file and EU-BOM.json contains the EU GPAI training-content disclosure mapping.

Excerpt from the card by Michael D'Agosta.

Configuration

Architecture
LlamaForCausalLM
Context length (tokens)
512
Layers
4
Hidden size
128
Feed-forward size
384
Attention heads
4
Key/value heads
2
Vocabulary size
259
RoPE base
10,000
Stored precision
bfloat16
Model type
llama

Identity and Version

Repository
mdagosta/waldito-smoke-v1-r0001-merge
Publisher
Michael D'Agosta
Task
Text generation
Modality
Text
Library
transformers
Parameters
820,736 parameters
Languages
Not stated by the source
Revision
45be95bffe794a83e7b37308af06e4b504ed96fd
First published
2026-09-30
Last updated
2026-09-30

Files and Weights

12 files, 2.1 MB in total. The weights are 1 file totalling 1.6 MB in safetensors.

Weights1 file · 1.6 MB
Configuration7 files · 412.4 KB
Tokenizer1 file · 712 B
Documentation1 file · 387 B
Other1 file · 381 B
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.6 MB d2d03feecf53
BOM.jsonConfiguration2.4 KB —
EU-BOM.jsonConfiguration407.4 KB —
architecture.pyConfiguration203 B —
config.jsonConfiguration458 B —
generation_config.jsonConfiguration79 B —
special_tokens_map.jsonConfiguration62 B —
tokenization_openwaldo.pyConfiguration1.9 KB —
README.mdDocumentation387 B —
chat_template.jinjaOther381 B —
.gitattributesRepository1.5 KB —
tokenizer_config.jsonTokenizer712 B —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
1.6 MB
Download from Michael D'Agosta

Released by Michael D'Agosta through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published1.6 MB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About waldito-smoke-v1-r0001-merge

How much GPU memory does waldito-smoke-v1-r0001-merge need?

About 0 GB at 16-bit and 0 GB at 4-bit: the weights (820,736 parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run waldito-smoke-v1-r0001-merge on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is waldito-smoke-v1-r0001-merge's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

This package uses the standard Transformers Llama causal-language-model architecture with OpenWALDO's schema-1 byte tokenizer. Load the tokenizer with trustremotecode=True. BOM.json inventories every release file and EU-BOM.json contains the EU GPAI training-content disclosure mapping.

Open weights 820,736 parameters 512 tokens transformers

This package uses the standard Transformers Llama causal-language-model architecture with OpenWALDO's schema-1 byte tokenizer. Load the tokenizer with trustremotecode=True. BOM.json inventories every release file and EU-BOM.json contains the EU GPAI training-content disclosure mapping.

Open weights 820,736 parameters 512 tokens transformers

This package uses the standard Transformers Llama causal-language-model architecture with OpenWALDO's schema-1 byte tokenizer. Load the tokenizer with trustremotecode=True. BOM.json inventories every release file and EU-BOM.json contains the EU GPAI training-content disclosure mapping.

Open weights 820,736 parameters 512 tokens transformers

This package uses the standard Transformers Llama causal-language-model architecture with OpenWALDO's schema-1 byte tokenizer. Load the tokenizer with trustremotecode=True. BOM.json inventories every release file and EU-BOM.json contains the EU GPAI training-content disclosure mapping.

Open weights 820,736 parameters 512 tokens transformers

This package uses the standard Transformers Llama causal-language-model architecture with OpenWALDO's schema-1 byte tokenizer. Load the tokenizer with trustremotecode=True. BOM.json inventories every release file and EU-BOM.json contains the EU GPAI training-content disclosure mapping.

Open weights 820,736 parameters 512 tokens transformers

This package uses the standard Transformers Llama causal-language-model architecture with OpenWALDO's schema-1 byte tokenizer. Load the tokenizer with trustremotecode=True. BOM.json inventories every release file and EU-BOM.json contains the EU GPAI training-content disclosure mapping.

Open weights 820,736 parameters 512 tokens transformers