SAVRN
Search Contact SAVRN

Open-weight model · Text generation

nanoBeard-sloop-14M

by Lo Jahn Ihatetomatoes/nanoBeard-sloop-14M

nanoBeard-sloop-14M is an open-weight model for text generation from Lo Jahn. It has 14M parameters. At 16-bit it needs about 0 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

A tiny pirate-themed GPT trained from scratch on a piratized version of TinyStories, then SFT-tuned. Built as a learning project — closer to nanoGPT than to a production LM. - model.safetensors — model weights.

Parameters14M
Context—
Weights125.2 MB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve nanoBeard-sloop-14M (14M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 7, 2026.

nanoBeard-sloop-14M on every accelerator the SAVRN Index prices, at every precision

Model Card

A tiny pirate-themed GPT trained from scratch on a piratized version of TinyStories, then SFT-tuned. Built as a learning project — closer to nanoGPT than to a production LM. - model.safetensors — model weights. - config.json — architecture config (load into training.config.Config). - piratebpe.json — tokenizer (load with tokenizers.Tokenizer.fromfile). - trainingmetadata.json — full training config + metrics snapshot. - banner.png — the banner above. This model is not a transformers model — it uses the custom GPT class from this repo. - Trained on a small synthetic corpus (TinyStories, piratized). Vocabulary, grammar, and world knowledge are extremely narrow. - Short context window (256…

Excerpt from the card by Lo Jahn.

Configuration

Architecture
GPT
Vocabulary size
8,192
Model type
nanobeard-gpt

Identity and Version

Repository
Ihatetomatoes/nanoBeard-sloop-14M
Publisher
Lo Jahn
Task
Text generation
Modality
Text
Library
pytorch
Parameters
14M parameters
Languages
en
Revision
3113dff54bf15f4d3489db264cc5d0297eda46a8
First published
2026-10-03
Last updated
2026-10-03

Files and Weights

10 files, 125.9 MB in total. The weights are 2 files totalling 125.2 MB in onnx, safetensors.

Weights2 files · 125.2 MB
Configuration4 files · 556.1 KB
Tokenizer1 file · 146.4 KB
Documentation1 file · 3.1 KB
Other1 file · 41.4 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.onnxWeights68.1 MB 2fd326afb048
model.safetensorsWeights57.0 MB bab81fda587e
config.jsonConfiguration198 B —
model_config.jsonConfiguration167 B —
pirate_bpe.jsonConfiguration554.8 KB —
training_metadata.jsonConfiguration1.0 KB —
README.mdDocumentation3.1 KB —
banner.pngOther41.4 KB —
.gitattributesRepository1.5 KB —
tokenizer.tiktoken.jsonTokenizer146.4 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
125.2 MB
Download from Lo Jahn

Released by Lo Jahn through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published125.2 MB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About nanoBeard-sloop-14M

How much GPU memory does nanoBeard-sloop-14M need?

About 0 GB at 16-bit and 0 GB at 4-bit: the weights (14M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run nanoBeard-sloop-14M on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Similar Models

Model · Text generation

hypa-tiny-keys

Hypa-Intelligence

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Open weights 15M parameters 512 tokens transformers

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Open weights 11M parameters transformers

Model · Text generation

ldt-10m

Compactbot

A 10,284,480-parameter LLaMA-style text model, trained from scratch. This is a verified first checkpoint for the LDT-10M request (model-requests #12, DedeProGames) — real weights, real training, but undertrained (see the honest status below). It is not a quality release yet; the card states that plainly. Standard LLaMA block, no sliding window, no GQA: The parameter count is the learnable total: the raw safetensors sum is 14,216,640, which double-counts the tied embedding (tok.weight 12288×320 = 3,932,160) that head.weight aliases. Tied, the true count is 10,284,480. - Trained from scratch (no base model). The model learned real context — val loss 4.602 is well below the 7.38 unigram floor…

Open weights mit 10M parameters 512 tokens transformers

Model · Text generation

Hush-Nano-Chat

Leecz

Hush-Nano-Chat is an English, single-turn instruction-tuned version of Soulitude/Hush-Nano. It starts from the 22M-parameter pretrained model and uses supervised fine-tuning (SFT) on instruction–response pairs. Due to the model's limited parameters, its response can be inaccurate, incomplete, or inconsistent. Hush-Nano-Chat has the following features: The base model was pretrained on 8.5B tokens (8,554,042,292) drawn from the following subsets: Then it was fine-tuned on a mixture of the following datasets: unsloth/alpaca-cleaned, databricks/databricks-dolly-15k, and HuggingFaceH4/norobots. Only the assistant response and ending EOS token contribute to the training loss. Zero-shot normalized…

Open weights apache-2.0 23M parameters 1,024 tokens transformers

Model · Text generation

Ornith-1.0-9B

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit 1M parameters 262,144 tokens transformers

This package uses the standard Transformers Llama causal-language-model architecture with OpenWALDO's schema-1 byte tokenizer. Load the tokenizer with trustremotecode=True. BOM.json inventories every release file and EU-BOM.json contains the EU GPAI training-content disclosure mapping.

Open weights 820,736 parameters 512 tokens transformers