SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

Qwen3.8-27B-NVFP4-RTX5090

by Gittensor Model Hub gittensor-model-hub/Qwen3.8-27B-NVFP4-RTX5090

Runs on SparkInfer, SGLang and vLLM unmodified — configs for all three are below. Serving many users at once? See concurrency.

Parameters14.6B
Context262,144
Weights17.9 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads839.4k

Runs On

What it takes to serve Qwen3.8-27B-NVFP4-RTX5090 (14.6B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 29.1 GB 34.9 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 14.6 GB 17.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 7.3 GB 8.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on Qwen3.8-27B-NVFP4-RTX5090

This one was built for a single GeForce RTX 5090. Gittensor Model Hub took Qwen/Qwen3.8-27B, quantized it to NVFP4, and packaged it to serve the full 262,144-token context on 32 GB, with configs for SparkInfer, SGLang and vLLM. Our table puts memory at 34.9 GB for 16-bit, 17.5 GB for 8-bit and 8.7 GB for 4-bit; one MI300X at $1.85 per hour is the cheapest rental, but the point of this build is the card it was tuned for.

Apache 2.0 permits commercial use, modification and redistribution if you keep the license and notice files and state significant changes. Two things to check. The 264.8 tokens per second, up to 420 on code, and the 4.3x figure are the publisher's numbers with the DSpark v2 drafter, not ours. And the page reads 14.6B parameters while the name says 27B, so confirm which checkpoint you are loading.

Model Card

By Gittensor Model Hub, published under apache-2.0, revision 5b7a687fc821.

RTX5090 Blackwell GPU Optimized Qwen-3.8-27B-NVFP4

Runs on SparkInfer, SGLang and vLLM unmodified — configs for all three are below. Serving many users at once? See concurrency.

420 tok/s writing code. One consumer GPU.

SparkInfer × this NVFP4 build × the DSpark v2 drafter — an engine, a checkpoint, and a speculative drafter optimized against each other, compounding to 4.3×. The drafter never changes what the model says: the target verifies every drafted token.

GeForce RTX 5090–specific NVFP4 checkpoint of Qwen/Qwen3.8-27B, quantized with NVIDIA Model Optimizer. Serves the full native 262,144-token context on 32 GB.

With the DSpark v2 drafter: 264.8 tok/s overall — up to 420 on code — on SparkInfer (its bench harness; the HTTP server is autoregressive-only today) and 161.7 tok/s on SGLang's OpenAI server. Without speculation: 92.9 tok/s SparkInfer · 85.8 SGLang.

Read the full model card (3,479 words)

Configuration

Architecture
Qwen3_5ForConditionalGeneration
Context length (tokens)
262,144
Layers
64
Hidden size
5,120
Feed-forward size
17,408
Attention heads
24
Key/value heads
4
Head dimension
256
Vocabulary size
248,320
Model type
qwen3_5
Quantization
modelopt

Identity and Version

Repository
gittensor-model-hub/Qwen3.8-27B-NVFP4-RTX5090
Publisher
Gittensor Model Hub
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
14.6B parameters
Languages
rtx-5090
Revision
5b7a687fc8211a5d631c8ca6a593dd37eb26ce33
First published
2026-08-14
Last updated
2026-09-10

Files and Weights

32 files, 17.9 GB in total. The weights are 2 files totalling 17.9 GB in safetensors.

Weights2 files · 17.9 GB
Configuration7 files · 260.9 KB
Tokenizer4 files · 22.9 MB
Documentation3 files · 105.2 KB
Other15 files · 3.6 MB
Repository1 file · 2.2 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00002.safetensorsWeights10.0 GB cdd37b0e61ec
model-00002-of-00002.safetensorsWeights7.9 GB 713b84b8287e
config.jsonConfiguration13.2 KB
generation_config.jsonConfiguration213 B
hf_quant_config.jsonConfiguration9.1 KB
model.safetensors.index.jsonConfiguration236.5 KB
preprocessor_config.jsonConfiguration390 B
processor_config.jsonConfiguration1.2 KB
video_preprocessor_config.jsonConfiguration385 B
LICENSEDocumentation11.5 KB
README.mdDocumentation28.6 KB
README.qwen-upstream.mdDocumentation65.0 KB
assets/rtx5090-accuracy.pngOther86.0 KB
assets/rtx5090-context-vs.pngOther230.8 KB c10600f7439d
assets/rtx5090-context.pngOther81.9 KB
assets/rtx5090-decode.pngOther88.7 KB 2ad1c493144c
assets/rtx5090-engines.pngOther265.7 KB 6edd0152d89d
assets/rtx5090-hero-engines.pngOther309.0 KB c7599484f01e
assets/rtx5090-hero-final.pngOther1.5 MB 8cc0baee6979
assets/rtx5090-hero.pngOther123.7 KB 65fdb7d51c26
assets/rtx5090-overview.pngOther152.1 KB 798041c149f0
assets/rtx5090-spec.pngOther122.5 KB 96d4caee2038
assets/rtx5090-speculation.pngOther171.6 KB ac404b7bc6ad
assets/rtx5090-ttft.pngOther71.9 KB
assets/rtx5090-vs-competitors.pngOther312.2 KB bb3915db1add
chat_template.jinjaOther14.2 KB
crc32.txtOther86 B
.gitattributesRepository2.2 KB
merges.txtTokenizer3.4 MB
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer1.1 KB
vocab.jsonTokenizer6.7 MB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
17.9 GB
Download from Gittensor Model Hub

Released by Gittensor Model Hub through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published17.9 GB
16-bit29.1 GB
8-bit14.6 GB
4-bit7.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.8-27B-NVFP4-RTX5090

How much GPU memory does Qwen3.8-27B-NVFP4-RTX5090 need?

About 34.9 GB at 16-bit and 8.7 GB at 4-bit: the weights (14.6B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen3.8-27B-NVFP4-RTX5090 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use Qwen3.8-27B-NVFP4-RTX5090 commercially?

Yes. Qwen3.8-27B-NVFP4-RTX5090 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is Qwen3.8-27B-NVFP4-RTX5090's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

Qwen3.8-27B-NVFP4

RadixArk

The RadixArk Qwen3.8-27B-NVFP4 model is the quantized version of Qwen/Qwen3.8-27B. The quantization was produced at RadixArk using NVIDIA Model Optimizer, following a mixed NVFP4 W4A4 recipe. Run on SGLang: launch command and per-platform recipes in the Qwen3.8-27B cookbook. This model is not owned or developed by RadixArk. It is a quantized derivative of Qwen's model; see the upstream Qwen3.8-27B model card for the source model's capabilities, training information, limitations, and license. Global Developers looking to deploy an off-the-shelf, pre-quantized model in AI agent systems, chatbots, RAG systems, and other AI-powered applications. Hugging Face 08/14/2026 via…

Open weights apache-2.0 18.2B parameters 262,144 tokens Model Optimizer

Model · Image and text to text

VLX-Seek-1.5-10B

OmAI Lab

VLX-Seek-1.5-10B is the open-source 10B model in the VLX-Seek 1.5 family, designed for fine-grained perception and visual grounding in embodied scenarios. It targets practical settings such as drones, robots, robotic dogs, surveillance cameras, inspection systems, and other edge-side visual intelligence applications where a model must identify what is present, localize the right instance, and avoid grounding objects that are absent. Unlike coordinate-generation-based VLMs that directly decode bounding-box numbers, VLX-Seek reformulates localization as region retrieval and region reference. Candidate visual regions are represented as addressable entities, and the model answers by selecting…

Open weights apache-2.0 10B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.8-27B-NVFP4-QAD

Local Inference Lab

WORK IN PROGRESS A mixed NVFP4/MXFP8 quantization-aware distillation of Qwen3.8-27B, trained for one epoch. The student learns from the original BF16 teacher while its MLP weights are quantized in the forward pass. Distillation updates the MLP weights and text normalization weights to account for quantization error. This is a trained distillation checkpoint, not a post-training conversion of the original weights. Attention/GDN projections and the LM head were frozen in their MXFP8 representations during distillation. Packed NVFP4 and MXFP8 weights reconstruct to the same BF16 weight values used by the student during training. The tokenizer, chat template, generation configuration and…

Open weights apache-2.0 19.2B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.5-9B

Qwen

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. Empty cells (--) indicate scores not…

Open weights apache-2.0 9.7B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.5-9B-AWQ

QuantTrio

This repo quantizes the model using data-free quantization technique. As of 2026-02-25, make sure your system has cuda12.8 installed. Then, create a fresh Python environment (e.g. python3.12 venv) and run: Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after…

Open weights apache-2.0 9.7B parameters 262,144 tokens transformers