Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

d

by Khtsly khtsly/d

d is an open-weight model for text generation from Khtsly. It has 2.7B parameters and a 1,048,576-token context. At 16-bit it needs about 6.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 3.1k downloads a month.

In-training periodic checkpoint (step 16300). Architecture: Kimi K3 mini port (KimiLinearForCausalLM). Not a finished model -- intermediate weights uploaded during training for safekeeping/diffing.

Parameters2.7B
Context1,048,576
Weights15.8 GB
License—
AccessOpen weights
Monthly Downloads3.1k

Runs On

What it takes to serve d (2.7B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 5.4 GB 6.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 2.7 GB 3.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 1.3 GB 1.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 19, 2026.

d on every accelerator the SAVRN Index prices, at every precision

Model Card

In-training periodic checkpoint (step 16300). Architecture: Kimi K3 mini port (KimiLinearForCausalLM). Not a finished model -- intermediate weights uploaded during training for safekeeping/diffing.

Excerpt from the card by Khtsly.

Configuration

Architecture
KimiLinearForCausalLM
Context length (tokens)
1,048,576
Layers
32
Hidden size
2,560
Feed-forward size
6,144
Attention heads
20
Key/value heads
20
Vocabulary size
32,768
Experts
0
Experts active per token
0
Model type
kimi_linear

Identity and Version

Repository
khtsly/d
Publisher
Khtsly
Task
Text generation
Modality
Text
Library
transformers
Parameters
2.7B parameters
Languages
en
Revision
8dd8e3e1fce639eb92f8f7fc9211ac0749cbcef0
First published
2026-10-08
Last updated
2026-10-14

Files and Weights

7 files, 15.8 GB in total. The weights are 2 files totalling 15.8 GB in pt, safetensors.

Weights2 files · 15.8 GB
Configuration1 file · 1.7 KB
Documentation1 file · 308 B
Other2 files · 762.1 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
k3_2b-latest.ptWeights10.5 GB b5560268e359
model.safetensorsWeights5.4 GB d6a4b3aa1e33
config.jsonConfiguration1.7 KB —
README.mdDocumentation308 B —
metrics.jsonlOther624.5 KB —
metrics.pngOther137.6 KB a0e31c491da5
.gitattributesRepository1.6 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
15.8 GB
Download from Khtsly

Released by Khtsly through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published15.8 GB
16-bit5.4 GB
8-bit2.7 GB
4-bit1.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About d

How much GPU memory does d need?

About 6.4 GB at 16-bit and 1.6 GB at 4-bit: the weights (2.7B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run d on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is d's context length?

1,048,576 tokens, from the maximum position embeddings in its published configuration.

Similar Models

An English LFM2.5 2.6B checkpoint associated with the Trendyol Cybersecurity Instruction Tuning Dataset. This repository contains both Transformers-format model files and local GGUF exports. This is a research release. The repository does not currently publish benchmark, baseline-comparison, or safety-evaluation results. Transformers assets include model.safetensors, configuration files, tokenizer files, and a chat template. Keeping both formats in one repository is convenient, but users should explicitly choose the path that matches their runtime. The checked configuration includes a bitsandbytes quantization block. Pin and test the exact Transformers, Accelerate, bitsandbytes, and device…

Open weights apache-2.0 2.7B parameters 131,072 tokens transformers

Model · Text generation

LFM2.5-24B-A2B-JANGH2

Osaurus-AI

A JANG bundle of LiquidAI/LFM2.5-24B-A2B: Liquid AI's 24B mixture-of-experts reasoning model with 2B active parameters (40 layers: 30 short-convolution and 10 full-attention, 64 routed experts with 4 active, two dense layers), built for on-device agents. It always thinks before answering and calls tools in Liquid's Pythonic format. 44.7 GiB of bf16 weights in 7.3 GiB. Every quantized matrix with an input Hessian was rounded with GPTQ. The Hessians come from the model's own outputs: the bf16 model wrote its thinking and answers for math, finance, code in eleven languages, terminal and coding-agent sessions (with real tool results), multi-step tool calls, networking, cybersecurity, science…

Open weights apache-2.0 2.7B parameters 131,072 tokens mlx

Model · Text generation

MiniCPM5-2B

OpenBMB

English | We are releasing MiniCPM5-2B, the second model in the MiniCPM5 series, following MiniCPM5-1B. It is a dense 2B Transformer that scales up the same training recipe, built for on-device, local deployment, and resource-constrained scenarios, reaching 2B-class open-source SOTA. 2B-class open-source SOTA: compared with strong open-source models of similar size, MiniCPM5-2B achieves SOTA performance within this comparison set. It remains competitive with 4B-class models overall, while showing its advantages over models of comparable size in coding, mathematics, long-context understanding, tool use, and agentic tasks. font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto…

Open weights apache-2.0 2.5B parameters 131,072 tokens transformers

Model · Text generation

MiniCPM5-2B-Math

Caldalis

English | MiniCPM5-2B-Math is a math and proof model built on MiniCPM5: a dense 2.5B model based on MiniCPM5-2B and post-trained for long-form mathematical reasoning and proof writing. It runs on a single consumer GPU or a laptop and keeps the native 128K context. - Strong for its size. As a plain single call with up to 128K tokens of thinking, 92.3 on AIME 2025, 89.8 on AIME 2026 and 81.8 on HMMT February 2026 (avg@16), and 100 / 93.3 / 90.9 with a 16-sample vote. The official general-purpose MiniCPM5-2B scores 87.1 / 89.8 / 68.4 under the same protocol. - Writes checkable proofs. On IMO-ProofBench Basic, an average single call with up to 128K tokens writes a complete proof for 21 of the…

Open weights apache-2.0 2.5B parameters 131,072 tokens transformers

A 2B-parameter Qwen3.5 fine-tune, part of the Opus-Distil line in the reaperdoesntknow open-weight portfolio. Text-generation / reasoning model, trained with Unsloth + Hugging Face TRL.

Open weights apache-2.0 2.3B parameters 262,144 tokens transformers

Model · Text generation

Qwen3.5-2B-CyberSec

Convergent Intelligence

An English Qwen3.5 2B checkpoint associated with the Trendyol Cybersecurity Instruction Tuning Dataset and exported in Transformers / Safetensors format. This release is intended for research and local experimentation. The repository does not currently publish benchmark or safety-evaluation results, so the model should not be treated as a validated cybersecurity authority. The configuration identifies a Qwen3.5 conditional-generation architecture with text and vision components. Use a recent Transformers release that supports this architecture. Dependency and device behavior can vary across Transformers versions. Pin a tested environment for reproducible use. - Research on small-model…

Open weights apache-2.0 2.3B parameters 262,144 tokens transformers