Quantized version of https://huggingface.co/Qwen/Qwen3.8-27B
Search public pages, research tools, and SAVRN solutions.
Open-weight model · Image and text to text
by Gittensor Model Hub gittensor-model-hub/Qwen3.8-27B-NVFP4-RTX5090
Runs on SparkInfer, SGLang and vLLM unmodified — configs for all three are below. Serving many users at once? See concurrency.
What it takes to serve Qwen3.8-27B-NVFP4-RTX5090 (14.6B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 29.1 GB | 34.9 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 14.6 GB | 17.5 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 7.3 GB | 8.7 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.
This one was built for a single GeForce RTX 5090. Gittensor Model Hub took Qwen/Qwen3.8-27B, quantized it to NVFP4, and packaged it to serve the full 262,144-token context on 32 GB, with configs for SparkInfer, SGLang and vLLM. Our table puts memory at 34.9 GB for 16-bit, 17.5 GB for 8-bit and 8.7 GB for 4-bit; one MI300X at $1.85 per hour is the cheapest rental, but the point of this build is the card it was tuned for.
Apache 2.0 permits commercial use, modification and redistribution if you keep the license and notice files and state significant changes. Two things to check. The 264.8 tokens per second, up to 420 on code, and the 4.3x figure are the publisher's numbers with the DSpark v2 drafter, not ours. And the page reads 14.6B parameters while the name says 27B, so confirm which checkpoint you are loading.
By Gittensor Model Hub, published under apache-2.0, revision 5b7a687fc821.
Runs on SparkInfer, SGLang and vLLM unmodified — configs for all three are below. Serving many users at once? See concurrency.
SparkInfer × this NVFP4 build × the DSpark v2 drafter — an engine, a checkpoint, and a speculative drafter optimized against each other, compounding to 4.3×. The drafter never changes what the model says: the target verifies every drafted token.
GeForce RTX 5090–specific NVFP4 checkpoint of Qwen/Qwen3.8-27B, quantized with NVIDIA Model Optimizer. Serves the full native 262,144-token context on 32 GB.
With the DSpark v2 drafter: 264.8 tok/s overall — up to 420 on code — on SparkInfer (its bench harness; the HTTP server is autoregressive-only today) and 161.7 tok/s on SGLang's OpenAI server. Without speculation: 92.9 tok/s SparkInfer · 85.8 SGLang.
32 files, 17.9 GB in total. The weights are 2 files totalling 17.9 GB in safetensors.
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model-00001-of-00002.safetensors | Weights | 10.0 GB | cdd37b0e61ec |
| model-00002-of-00002.safetensors | Weights | 7.9 GB | 713b84b8287e |
| config.json | Configuration | 13.2 KB | — |
| generation_config.json | Configuration | 213 B | — |
| hf_quant_config.json | Configuration | 9.1 KB | — |
| model.safetensors.index.json | Configuration | 236.5 KB | — |
| preprocessor_config.json | Configuration | 390 B | — |
| processor_config.json | Configuration | 1.2 KB | — |
| video_preprocessor_config.json | Configuration | 385 B | — |
| LICENSE | Documentation | 11.5 KB | — |
| README.md | Documentation | 28.6 KB | — |
| README.qwen-upstream.md | Documentation | 65.0 KB | — |
| assets/rtx5090-accuracy.png | Other | 86.0 KB | — |
| assets/rtx5090-context-vs.png | Other | 230.8 KB | c10600f7439d |
| assets/rtx5090-context.png | Other | 81.9 KB | — |
| assets/rtx5090-decode.png | Other | 88.7 KB | 2ad1c493144c |
| assets/rtx5090-engines.png | Other | 265.7 KB | 6edd0152d89d |
| assets/rtx5090-hero-engines.png | Other | 309.0 KB | c7599484f01e |
| assets/rtx5090-hero-final.png | Other | 1.5 MB | 8cc0baee6979 |
| assets/rtx5090-hero.png | Other | 123.7 KB | 65fdb7d51c26 |
| assets/rtx5090-overview.png | Other | 152.1 KB | 798041c149f0 |
| assets/rtx5090-spec.png | Other | 122.5 KB | 96d4caee2038 |
| assets/rtx5090-speculation.png | Other | 171.6 KB | ac404b7bc6ad |
| assets/rtx5090-ttft.png | Other | 71.9 KB | — |
| assets/rtx5090-vs-competitors.png | Other | 312.2 KB | bb3915db1add |
| chat_template.jinja | Other | 14.2 KB | — |
| crc32.txt | Other | 86 B | — |
| .gitattributes | Repository | 2.2 KB | — |
| merges.txt | Tokenizer | 3.4 MB | — |
| tokenizer.json | Tokenizer | 12.8 MB | 0997f410c57a |
| tokenizer_config.json | Tokenizer | 1.1 KB | — |
| vocab.json | Tokenizer | 6.7 MB | — |
Released by Gittensor Model Hub through its official repository on Hugging Face. Read the license.
| Precision | Weights in memory |
|---|---|
| As published | 17.9 GB |
| 16-bit | 29.1 GB |
| 8-bit | 14.6 GB |
| 4-bit | 7.3 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
About 34.9 GB at 16-bit and 8.7 GB at 4-bit: the weights (14.6B parameters) plus a working margin. A long context needs more.
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Yes. Qwen3.8-27B-NVFP4-RTX5090 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
262,144 tokens, from the maximum position embeddings in its published configuration.
Quantized version of https://huggingface.co/Qwen/Qwen3.8-27B
The RadixArk Qwen3.8-27B-NVFP4 model is the quantized version of Qwen/Qwen3.8-27B. The quantization was produced at RadixArk using NVIDIA Model Optimizer, following a mixed NVFP4 W4A4 recipe. Run on SGLang: launch command and per-platform recipes in the Qwen3.8-27B cookbook. This model is not owned or developed by RadixArk. It is a quantized derivative of Qwen's model; see the upstream Qwen3.8-27B model card for the source model's capabilities, training information, limitations, and license. Global Developers looking to deploy an off-the-shelf, pre-quantized model in AI agent systems, chatbots, RAG systems, and other AI-powered applications. Hugging Face 08/14/2026 via…
VLX-Seek-1.5-10B is the open-source 10B model in the VLX-Seek 1.5 family, designed for fine-grained perception and visual grounding in embodied scenarios. It targets practical settings such as drones, robots, robotic dogs, surveillance cameras, inspection systems, and other edge-side visual intelligence applications where a model must identify what is present, localize the right instance, and avoid grounding objects that are absent. Unlike coordinate-generation-based VLMs that directly decode bounding-box numbers, VLX-Seek reformulates localization as region retrieval and region reference. Candidate visual regions are represented as addressable entities, and the model answers by selecting…
WORK IN PROGRESS A mixed NVFP4/MXFP8 quantization-aware distillation of Qwen3.8-27B, trained for one epoch. The student learns from the original BF16 teacher while its MLP weights are quantized in the forward pass. Distillation updates the MLP weights and text normalization weights to account for quantization error. This is a trained distillation checkpoint, not a post-training conversion of the original weights. Attention/GDN projections and the LM head were frozen in their MXFP8 representations during distillation. Packed NVFP4 and MXFP8 weights reconstruct to the same BF16 weight values used by the student during training. The tokenizer, chat template, generation configuration and…
Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. Empty cells (--) indicate scores not…
This repo quantizes the model using data-free quantization technique. As of 2026-02-25, make sure your system has cuda12.8 installed. Then, create a fresh Python environment (e.g. python3.12 venv) and run: Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after…