SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

q35-sr-step24

by Trxcc2002 trxcc2002/q35-sr-step24

q35-sr-step24 is an open-weight model for image and text to text from Trxcc2002. It has 9.7B parameters and a 262,144-token context. At 16-bit it needs about 23.2 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This repository contains the completed training step25 HF export. The repository name retains step24 for compatibility with the requested upload destination. Optimizer and scheduler state are not included.

Parameters9.7B
Context262,144
Weights19.3 GB
License
AccessOpen weights
Monthly Downloads

Runs On

What it takes to serve q35-sr-step24 (9.7B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 19.3 GB 23.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 9.7 GB 11.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.8 GB 5.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 24, 2026.

q35-sr-step24 on every accelerator the SAVRN Index prices, at every precision

Model Card

This repository contains the completed training step25 HF export. The repository name retains step24 for compatibility with the requested upload destination. Optimizer and scheduler state are not included.

Excerpt from the card by Trxcc2002.

Configuration

Architecture
Qwen3_5ForConditionalGeneration
Context length (tokens)
262,144
Layers
32
Hidden size
4,096
Feed-forward size
12,288
Attention heads
16
Key/value heads
4
Head dimension
256
Vocabulary size
248,320
RoPE base
10,000,000
Model type
qwen3_5

Identity and Version

Repository
trxcc2002/q35-sr-step24
Publisher
Trxcc2002
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
9.7B parameters
Languages
Not stated by the source
Revision
d6fbf410505fa5c4fd6f58427bb6d62408a6f6db
First published
2026-09-24
Last updated
2026-09-24

Files and Weights

13 files, 19.3 GB in total. The weights are 4 files totalling 19.3 GB in safetensors.

Weights4 files · 19.3 GB
Configuration4 files · 87.2 KB
Tokenizer2 files · 20.0 MB
Documentation1 file · 306 B
Other1 file · 7.8 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensors-00001-of-00004.safetensorsWeights5.3 GB 91e46cdab3db
model.safetensors-00002-of-00004.safetensorsWeights5.3 GB 04cf45ff2ac6
model.safetensors-00003-of-00004.safetensorsWeights5.4 GB 5c61f451e04a
model.safetensors-00004-of-00004.safetensorsWeights3.3 GB d449252f4751
config.jsonConfiguration2.8 KB
model.safetensors.index.jsonConfiguration82.8 KB
preprocessor_config.jsonConfiguration443 B
processor_config.jsonConfiguration1.2 KB
README.mdDocumentation306 B
chat_template.jinjaOther7.8 KB
.gitattributesRepository1.6 KB
tokenizer.jsonTokenizer20.0 MB 06b9509352d2
tokenizer_config.jsonTokenizer1.2 KB

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
19.3 GB
Download from Trxcc2002

Released by Trxcc2002 through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published19.3 GB
16-bit19.3 GB
8-bit9.7 GB
4-bit4.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About q35-sr-step24

How much GPU memory does q35-sr-step24 need?

About 23.2 GB at 16-bit and 5.8 GB at 4-bit: the weights (9.7B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run q35-sr-step24 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is q35-sr-step24's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

Qwen3.5-9B

Qwen

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. Empty cells (--) indicate scores not…

Open weights apache-2.0 9.7B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.5-9B-AWQ

QuantTrio

This repo quantizes the model using data-free quantization technique. As of 2026-02-25, make sure your system has cuda12.8 installed. Then, create a fresh Python environment (e.g. python3.12 venv) and run: Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after…

Open weights apache-2.0 9.7B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen-Image-2.1-PE-I2I-Heretic

Darrellbest

The image-editing prompt rewriter for Qwen-Image-2.1, a fine-tuned Qwen3.5-VL 9B that turns a short edit instruction plus 1–N input images into a detailed English edit prompt, with its refusal behaviour removed by Heretic directional ablation. bf16, same shapes and parameter count as the source; nothing else was changed. systemprompt.txt is included and required. It defines the output format. It is the unmodified file from the source repo. The second row is an independent evaluation of the exported weights with Heretic's evaluatemodel. Refusals were measured on mlabonne/harmfulbehaviors and KL divergence (damage to ordinary behaviour, first-token distributions) on mlabonne/harmlessalpaca…

Open weights other 9.4B parameters 262,144 tokens

Model · Image and text to text

LucidVitality-9b

Matthew Andrews

LucidVitality-9B is a little goer. It's a roleplay or creative focused merge of two Qwen3.5 9b variants for people with absolute potatoes, like myself. It marries the improved prose of Darkhn's Qwen3.5-9B-Animus-V13.0 with the lower looping, higher EOS exit, and slightly more coherency (compared to base) from Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED of DavidAU's making. I haven't merged anything for a long time, as it's been a hard time for finetuning. They rarely increase prose quality, often deeply lose intelligence over base (even when tuned for intelligence or agentic). Base model's getting tough to beat. So it was a pleasant surprise to find two models that each…

Open weights 9.4B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen-Image-2.1-PE-I2I-Heretic-NVFP4

Darrellbest

NVFP4 (4-bit floating point, W4A4) build of darrellbest/Qwen-Image-2.1-PE-I2I-Heretic, the refusal-ablated image-editing prompt rewriter for Qwen-Image-2.1. For vLLM on NVIDIA Blackwell GPUs, which run NVFP4 natively. 11 GB instead of 18 GB. systemprompt.txt is included and required, exactly as for the original. The linear-attention layers carry a recurrent state and the vision tower encodes the input image; both were left in bf16, as other quantizations of this model family do. That is why the file is 11 GB rather than ~6 GB. Made with llm-compressor 0.13.0 (QuantizationModifier, scheme="NVFP4"), calibrated on 64 samples in the model's real input format: its own system prompt, an edit…

Open weights other 9.4B parameters 262,144 tokens

Model · Image and text to text

Omni-Edu-9B

Hao Liang

This model is a fine-tuned version of Qwen/Qwen3.5-9B-Base on the Omni-Edu-70K dataset. The following hyperparameters were used during training: - learningrate: 5e-06 - trainbatchsize: 1 - evalbatchsize: 8 - distributedtype: multi-GPU - numdevices: 8 - gradientaccumulationsteps: 8 - totaltrainbatchsize: 64 - totalevalbatchsize: 64 - lrschedulertype: cosine - lrschedulerwarmupsteps: 0.1 - numepochs: 3.0 - Transformers 5.2.0 - Pytorch 2.10.0 - Datasets 4.0.0 - Tokenizers 0.22.2

Open weights other 9.4B parameters 262,144 tokens transformers