Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64

by Facu Vlad J groxaxo/DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64

DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64 is an open-weight model for text generation from Facu Vlad J, released under Apache License 2.0. It has 9.7B parameters. At 16-bit it needs about 23.2 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

Parameters9.7B
Context—
Weights—
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64 (9.7B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 19.3 GB 23.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 9.7 GB 11.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.8 GB 5.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 22, 2026.

DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64 on every accelerator the SAVRN Index prices, at every precision

Model Card

Identity and Version

Repository
groxaxo/DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64
Publisher
Facu Vlad J
Task
Text generation
Modality
Text
Library
gptqmodel
Parameters
9.7B parameters
Languages
mtp
Revision
cbfc13d3370224483394a7808975501adee49b88
First published
2026-10-19
Last updated
2026-10-19

License and Download

License
apache-2.0
Access
Open weights, no gate
Download from Facu Vlad J

Released by Facu Vlad J through its official repository on Hugging Face. Read the license.

Built From

  • Derived from Jackrong/DeepSeek-V4-Pro-Qwen3.5-9B
  • Quantized from Jackrong/DeepSeek-V4-Pro-Qwen3.5-9B

Memory Requirements

PrecisionWeights in memory
16-bit19.3 GB
8-bit9.7 GB
4-bit4.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64

How much GPU memory does DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64 need?

About 23.2 GB at 16-bit and 5.8 GB at 4-bit: the weights (9.7B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64 commercially?

Yes. DeepSeek-V4-Pro-Qwen3.5-9B-GPTQPro-W4-G64 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

JackOD-9B-Coder

ManniX

A four-way omnimergev2 merge over Qwen/Qwen3.5-9B, built for one job: multi-turn agentic coding — staying on a task across turns and tool calls until it is actually finished. It is not built to win knowledge benchmarks, and its world knowledge is limited for its size. What it is built to do is finish, and stop. --base and --task-base are both Qwen3.5-9B: every source descends from it, so task vectors are taken against the true common ancestor instead of against a sibling. merge (--skip-patterns visual.,mtp.) and passed through, so the draft head survives — an averaged MTP head stops being a usable drafter. There is no vision tower. config.json inherits a populated visionconfig from the…

Open weights apache-2.0 9.7B parameters 262,144 tokens transformers

Qwen3.5-9B fine-tuned to reason mechanistically about genetic (CRISPR) perturbations and predict how a queried pathway responds — upregulated, downregulated, or unchanged — in a given cell. This is the cell-text arm of BioReasonCell: the v9.9 SFT recipe, with one change. The model gets no STATE cell embedding. It reads the cell as text instead, a Cell Context: block in the prompt, so it is a plain text model and every input it needs can be built from a new screen's h5ad. The block follows the queried pathway, and the prompt's opening reads "Given a cell's context, a genetic perturbation, …": Top Expressed Genes are the 50 most abundant genes of the line's non-targeting control cells…

Access requested at publisher other 9.4B parameters transformers

Model · Text generation

gemma-2-9b-it

Google

[Responsible Generative AI Toolkit][rai-toolkit] [Gemma on Kaggle][kaggle-gemma] [Gemma on Vertex Model Garden][vertex-mg-gemma] Summary description and brief definition of inputs and outputs. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. They are text-to-text, decoder-only large language models, available in English, with open weights for both pre-trained variants and instruction-tuned variants. Gemma models are well-suited for a variety of text generation tasks, including question answering, summarization, and reasoning. Their relatively small size makes it possible to deploy them…

Access requested at publisher gemma 9.2B parameters transformers

Model · Text generation

dQwen3.5-9B-Base

IFML

A masked diffusion language model adapted from Qwen3.5-9B. The backbone is hybrid: only its attention layers are made bidirectional, and the Gated DeltaNet layers stay causal. This is a base model, with no instruction tuning. Paper: dQwen3.5: Hybrid-Attention Diffusion Language Models. Code: https://github.com/AntonXue/dQwen Needs a CUDA GPU and transformers>=5.13 (tested with torch 2.7.1+cu128, flash-linear-attention 0.5.1). generate decodes the whole canvas at once, committing positions above a confidence threshold (tau=0.9); pass blocklength=32 for left-to-right block decoding, or tau=None, stepsperblock=k for a fixed budget. The 50B-token checkpoint from the paper is…

Open weights apache-2.0 9B parameters 262,144 tokens transformers