SAVRN
Search Contact SAVRN

Open-weight model · Text generation

zkhapo3.5-9b

by Zkhapo zkhapo/zkhapo3.5-9b

zkhapo3.5-9b is an open-weight model for text generation from Zkhapo. It has 9B parameters and a 262,144-token context. At 16-bit it needs about 21.5 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model.

Parameters9B
Context262,144
Weights17.9 GB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve zkhapo3.5-9b (9B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 17.9 GB 21.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 9.0 GB 10.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.5 GB 5.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 7, 2026.

zkhapo3.5-9b on every accelerator the SAVRN Index prices, at every precision

Model Card

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Excerpt from the card by Zkhapo.

Configuration

Architecture
Qwen3_5ForCausalLM
Context length (tokens)
262,144
Layers
32
Hidden size
4,096
Feed-forward size
12,288
Attention heads
16
Key/value heads
4
Head dimension
256
Vocabulary size
248,320
Model type
qwen3_5_text

Identity and Version

Repository
zkhapo/zkhapo3.5-9b
Publisher
Zkhapo
Task
Text generation
Modality
Text
Library
transformers
Parameters
9B parameters
Languages
Not stated by the source
Revision
e42c28e66e818341c2d9598f7bf87d9f0dab9ed5
First published
2026-10-06
Last updated
2026-10-06

Files and Weights

8 files, 17.9 GB in total. The weights are 1 file totalling 17.9 GB in safetensors.

Weights1 file · 17.9 GB
Configuration2 files · 2.1 KB
Tokenizer2 files · 20.0 MB
Documentation1 file · 5.2 KB
Other1 file · 7.8 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights17.9 GB 6c5492f150b5
config.jsonConfiguration2.0 KB —
generation_config.jsonConfiguration116 B —
README.mdDocumentation5.2 KB —
chat_template.jinjaOther7.8 KB —
.gitattributesRepository1.6 KB —
tokenizer.jsonTokenizer20.0 MB a5cd9732badc
tokenizer_config.jsonTokenizer1.2 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
17.9 GB
Download from Zkhapo

Released by Zkhapo through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published17.9 GB
16-bit17.9 GB
8-bit9.0 GB
4-bit4.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About zkhapo3.5-9b

How much GPU memory does zkhapo3.5-9b need?

About 21.5 GB at 16-bit and 5.4 GB at 4-bit: the weights (9B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run zkhapo3.5-9b on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is zkhapo3.5-9b's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

dQwen3.5-9B-Base

IFML

A masked diffusion language model adapted from Qwen3.5-9B. The backbone is hybrid: only its attention layers are made bidirectional, and the Gated DeltaNet layers stay causal. This is a base model, with no instruction tuning. Paper: dQwen3.5: Hybrid-Attention Diffusion Language Models. Code: https://github.com/AntonXue/dQwen Needs a CUDA GPU and transformers>=5.13 (tested with torch 2.7.1+cu128, flash-linear-attention 0.5.1). generate decodes the whole canvas at once, committing positions above a confidence threshold (tau=0.9); pass blocklength=32 for left-to-right block decoding, or tau=None, stepsperblock=k for a fixed budget. The 50B-token checkpoint from the paper is…

Open weights apache-2.0 9B parameters 262,144 tokens transformers

Model · Text generation

WikiQwen-9B

Devon Yanitski

Ask anything, get a how-to article. WikiQwen-9B is Qwen3.5-9B fine-tuned to answer every message the same way: as a tidy, step-by-step how-to article in markdown, with a picture caption above each step. Hand those captions to WikiQwen-Illustrator and they become illustrations. Send it a question ("how do I keep basil alive?"), a problem ("my bike chain keeps falling off") or just "hi", and it sends back a guide. Every reply has the same shape: - a # How to … title and a short intro - one or more ## Method N: or ## Part N: sections, or a single ## Steps - an [IMAGE: caption] line above each step, written for the Illustrator to draw - steps written as N. Bold summary. Details…, with bullets…

Open weights cc-by-nc-sa-4.0 9B parameters 262,144 tokens transformers

Model · Text generation

idefics-9b

HuggingFaceM4

How do I pronounce the model's name? Watch a Youtube tutorial IDEFICS (Image-aware Decoder Enhanced à la Flamingo with Interleaved Cross-attentionS) is an open-access reproduction of Flamingo, a closed-source visual language model developed by Deepmind. Like GPT-4, the multimodal model accepts arbitrary sequences of image and text inputs and produces text outputs. IDEFICS is built solely on publicly available data and models. The model can answer questions about images, describe visual contents, create stories grounded on multiple images, or simply behave as a pure language model without visual inputs. IDEFICS is on par with the original closed-source model on various image-text benchmarks…

Open weights other 8.9B parameters 2,048 tokens transformers

Model · Text generation

StandardOne-8B

Standard Thinking

Standard One scores a bounded set of answers for a supplied scenario and returns probabilities through POST /v1/systemone. It does not generate free-form response text. This repository contains the merged BF16 8B checkpoint and the server code. In the reported served evaluations, 8B scores higher than 3B on the public standard and hard tiers; 3B has a lower median latency on the measured short-request profile. See Benchmarks for the measurement conditions and limitations. The figure combines results from different measurement paths. See Benchmarks for served versus offline conditions; measured 24–26 September 2026. - Send a state and a bounded rubric to receive probabilities for the…

Open weights apache-2.0 8.9B parameters 262,144 tokens transformers

Model · Text generation

StandardOne-8B-FP8

Standard Thinking

StandardOne-8B-FP8 is an FP8 (compressed-tensors, float8e4m3 weights, dynamic per-token activations) quantization of the released StandardOne-8B decision model. The language-model linear projections (q/k/v/o, gate/up/down) are quantized per-channel FP8 E4M3 with dynamic FP8 activations (llm-compressor's data-free FP8DYNAMIC recipe, no calibration data required); the vision tower, multi-modal projector, embeddings and lmhead are left unquantized in BF16. It was produced from source revision e88423700bb5ab9b2f50e176cf19825914345272 of StandardOne-8B on 2026-09-25 using llm-compressor 0.14.0 (torch 2.14.0, transformers 5.17.0, compressed-tensors 0.19.0); results below. Served through SGLang…

Open weights apache-2.0 8.9B parameters 262,144 tokens transformers