SAVRN
Search Contact SAVRN

Open-weight model · Text generation

delta

by Convergent Intelligence reaperdoesntknow/delta

delta is an open-weight model for text generation from Convergent Intelligence. It has 410M parameters. At 16-bit it needs about 1 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model.

Parameters410M
Context—
Weights1.6 GB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve delta (410M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.8 GB 1.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.4 GB 0.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.2 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 7, 2026.

delta on every accelerator the SAVRN Index prices, at every precision

Model Card

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Excerpt from the card by Convergent Intelligence.

Configuration

Architecture
TAMELM
Vocabulary size
49,152
Experts
4
Model type
tamelm_two_axis

Identity and Version

Repository
reaperdoesntknow/delta
Publisher
Convergent Intelligence
Task
Text generation
Modality
Text
Library
transformers
Parameters
410M parameters
Languages
Not stated by the source
Revision
02fa248d782b028b826e6ee22b28d34e2f47efd1
First published
2026-10-04
Last updated
2026-10-04

Files and Weights

8 files, 1.6 GB in total. The weights are 1 file totalling 1.6 GB in safetensors.

Weights1 file · 1.6 GB
Configuration3 files · 75.8 KB
Tokenizer2 files · 3.5 MB
Documentation1 file · 5.2 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.6 GB 98a366f36665
config.jsonConfiguration1.1 KB —
generation_config.jsonConfiguration215 B —
modeling_tamelm.pyConfiguration74.4 KB —
README.mdDocumentation5.2 KB —
.gitattributesRepository1.5 KB —
tokenizer.jsonTokenizer3.5 MB —
tokenizer_config.jsonTokenizer499 B —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
1.6 GB
Download from Convergent Intelligence

Released by Convergent Intelligence through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published1.6 GB
16-bit0.8 GB
8-bit0.4 GB
4-bit0.2 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About delta

How much GPU memory does delta need?

About 1 GB at 16-bit and 0.2 GB at 4-bit: the weights (410M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run delta on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Similar Models

Model · Text generation

romeo

Convergent Intelligence

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Open weights 417M parameters transformers

Model · Text generation

AnuLM-Base-2K-400M

Pawan Kumar

The three-language base with a 2,048-token context: AnuLM-Base-400M continued for 10,000 steps at block 2,048 with YaRN, on 46M tokens of the same Hindi / English / Python proportions it was originally trained on. Five hours on one RTX 5070 Ti. Full log and the honest reading of what it bought: docs/RESULTS.md §28, with the zero-shot measurement it is compared against Hindi and English Wikipedia are CC BY-SA, C4 is ODC-BY, and the Python slice is codeparrot-clean, de-duplicated GitHub Python with mixed licences. Not affiliated with Sarvam AI, AI4Bharat, BharatGen or the Government of India. Every other checkpoint in this project is trained at 512 tokens. This one answers what happens if you…

Open weights cc-by-sa-4.0 398M parameters

Model · Text generation

LFM2.5-350M-TTS-v3

Kim

This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.

Access requested at publisher 383M parameters transformers

Model · Text generation

AMOR-GatedDeltaNet-440M

Haoran Zheng

Block 0 receives the backbone's final normalized output. Blocks 1 and 2 apply their own pre-normalization. A shared, embedding-tied LM head supplies all three entropy evaluations and the final output prediction. A complete recurrent backbone, refined by three entropy-gated attention blocks. Looking for the larger model? AMOR-Gated DeltaNet 1.5B. AMOR (Adaptive Metacognitive Output Router) uses the model's predictive uncertainty to decide where attention should refine its recurrent representation. Each appended block reads normalized output entropy, compares it with a frozen threshold at inference, and adds an attention update only where its gate fires. The recurrent backbone and attention…

Open weights mit 442M parameters pytorch

Model · Text generation

AMOR-Mamba2-440M

Haoran Zheng

Block 0 receives the backbone's final normalized output. Blocks 1 and 2 apply their own pre-normalization. A shared, embedding-tied LM head supplies all three entropy evaluations and the final output prediction. A complete recurrent backbone, refined by three entropy-gated attention blocks. Looking for the larger model? AMOR-Mamba2 1.5B. AMOR (Adaptive Metacognitive Output Router) uses the model's predictive uncertainty to decide where attention should refine its recurrent representation. Each appended block reads normalized output entropy, compares it with a frozen threshold at inference, and adds an attention update only where its gate fires. The recurrent backbone and attention blocks…

Open weights mit 449M parameters pytorch

Model · Text generation

SMOLM2Prover

Convergent Intelligence

SmolLM2Prover is a specialized, fine-tuned version of prithivMLmods/SmolLM2-CoT-360M. While retaining the strong conversational abilities of its base model, this version has been specifically enhanced to excel at deep thinking, logical reasoning, and higher-level mathematics, with a focus on generating step-by-step proofs and explanations (Chain-of-Thought). The model was fine-tuned using multiple rounds of Supervised Fine-Tuning (SFT) with the TRL library on a curated dataset, enhancing its ability to follow complex instructions and reason through problems. This model is intended to be used for text generation tasks that require logical reasoning or advanced conversation. The easiest way…

Open weights apache-2.0 362M parameters 8,192 tokens transformers