SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

Qwen3.8-Flash-Next-MLX-oQ3-MTP

by Robot Haus Robot-Haus/Qwen3.8-Flash-Next-MLX-oQ3-MTP

A sensitivity-guided, mixed-precision MLX conversion of Qwen/Qwen3.8-Flash-Next, rebuilt directly from the official BF16 checkpoint with the model's matching native MTP block preserved.

Parameters180B
Context262,144
Weights92.5 GB
Licenseother
AccessOpen weights
Monthly Downloads

Runs On

What it takes to serve Qwen3.8-Flash-Next-MLX-oQ3-MTP (180B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 360.0 GB 432.0 GB 2x MI325X (256 GB)
Vultr
$4.00 2x MI355X $5.18 · 3x MI300X $5.55
8-bit 180.0 GB 216.0 GB 1x MI325X (256 GB)
Vultr
$2.00 1x MI355X $2.59 · 2x MI300X $3.70
4-bit 90.0 GB 108.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x MI325X $2.00 · 1x MI355X $2.59

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

A sensitivity-guided, mixed-precision MLX conversion of Qwen/Qwen3.8-Flash-Next, rebuilt directly from the official BF16 checkpoint with the model's matching native MTP block preserved. oQ3 uses a 3-bit affine base and spends additional precision on sensitive modules. Layer sensitivity was measured with a validated quantized calibration proxy, while every released weight was quantized from the official BF16 checkpoint. The result is a compact model with 746 higher-precision module overrides rather than a uniform 3-bit layout. The upstream tokenizer, current chat template, vision processor, generation configuration, licence, and native MTP configuration are retained. In a compatible oMLX…

Excerpt from the card by Robot Haus, licensed other.

Configuration

Architecture
Qwen4ExpForConditionalGeneration
Context length (tokens)
262,144
Layers
48
Hidden size
2,560
Attention heads
24
Key/value heads
2
Head dimension
256
Vocabulary size
248,320
Experts
512
Experts active per token
10
Model type
qwen4_exp

Identity and Version

Repository
Robot-Haus/Qwen3.8-Flash-Next-MLX-oQ3-MTP
Publisher
Robot Haus
Task
Image and text to text
Modality
Image and text
Library
mlx
Parameters
180B parameters
Languages
mlx, mlx-vlm, oq, mtp
Revision
9ad88db89cd4cfe99aa7ac5f72c332ec669801fc
First published
2026-09-18
Last updated
2026-09-18

Files and Weights

32 files, 92.5 GB in total. The weights are 19 files totalling 92.5 GB in safetensors.

Weights19 files · 92.5 GB
Configuration4 files · 622.2 KB
Tokenizer4 files · 22.9 MB
Documentation2 files · 12.1 KB
Other2 files · 20.2 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00019.safetensorsWeights5.0 GB 2e88ac8b78aa
model-00002-of-00019.safetensorsWeights5.0 GB 65575f78ad03
model-00003-of-00019.safetensorsWeights5.0 GB cbfdd4079f0c
model-00004-of-00019.safetensorsWeights5.0 GB 95d085e26b87
model-00005-of-00019.safetensorsWeights5.0 GB 8ee18635f172
model-00006-of-00019.safetensorsWeights5.4 GB 6b241efd810e
model-00007-of-00019.safetensorsWeights5.0 GB f905b52826dd
model-00008-of-00019.safetensorsWeights5.0 GB 59960768a254
model-00009-of-00019.safetensorsWeights5.0 GB d05841bed970
model-00010-of-00019.safetensorsWeights5.0 GB fcc68a83c4b4
model-00011-of-00019.safetensorsWeights5.0 GB 52924176725b
model-00012-of-00019.safetensorsWeights5.0 GB 283f496cb87d
model-00013-of-00019.safetensorsWeights5.0 GB e55f9ef72ef8
model-00014-of-00019.safetensorsWeights5.0 GB df1386c94593
model-00015-of-00019.safetensorsWeights5.0 GB 3eab4b3bbfb5
model-00016-of-00019.safetensorsWeights5.0 GB 233bff2cea40
model-00017-of-00019.safetensorsWeights5.0 GB 0da468b0fdcc
model-00018-of-00019.safetensorsWeights5.0 GB 79f057dbe737
model-00019-of-00019.safetensorsWeights1.6 GB cb02071ccffc
config.jsonConfiguration215.8 KB
generation_config.jsonConfiguration202 B
model.safetensors.index.jsonConfiguration405.8 KB
preprocessor_config.jsonConfiguration390 B
LICENSEDocumentation3.2 KB
README.mdDocumentation8.9 KB
chat_template.jinjaOther9.0 KB
qwen-logo.pngOther11.2 KB
.gitattributesRepository1.6 KB
merges.txtTokenizer3.4 MB
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer17.9 KB
vocab.jsonTokenizer6.7 MB

License and Download

License
other
Access
Open weights, no gate
Download size
92.5 GB
Download from Robot Haus

Released by Robot Haus through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published92.5 GB
16-bit360.0 GB
8-bit180.0 GB
4-bit90.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.8-Flash-Next-MLX-oQ3-MTP

How much GPU memory does Qwen3.8-Flash-Next-MLX-oQ3-MTP need?

About 432 GB at 16-bit and 108 GB at 4-bit: the weights (180B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen3.8-Flash-Next-MLX-oQ3-MTP on?

At 16-bit, 2x MI325X from $4.00 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Qwen3.8-Flash-Next-MLX-oQ3-MTP released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen3.8-Flash-Next-MLX-oQ3-MTP's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

Qwen3.8-Flash-Next

Qwen

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other 180B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.8-Flash-Next-Uncensored-NVFP4

OrcaRouter

This model has had its safety alignment substantially removed via abliteration (orthogonalizing the refusal direction out of the residual stream). It will comply with harmful, unethical, or illegal requests the original Qwen3.8-Flash-Next would refuse. Released strictly for legitimate research — interpretability, AI-safety / refusal-mechanism study, red-teaming, and robustness evaluation. You assume full responsibility for how you use it and everything it generates; add your own safety and moderation layers before any deployment. Use must comply with the Apache 2.0 License inherited from the base model and all applicable law. The authors accept no liability for misuse. - A Blackwell GPU…

Access requested at publisher apache-2.0 180B parameters transformers

Model · Image and text to text

Qwen3.8-Flash-Next

Tai Hua

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other 180B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.5-122B-A10B-FP8

Qwen

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. Empty cells (--) indicate scores not…

Open weights apache-2.0 125.1B parameters 262,144 tokens transformers

Model · Image and text to text

GLM-5.3-Flash

Z.ai

Join our WeChat or Discord community. Check out the GLM-5.3-Flash blog and GLM-5 Technical report. Use GLM-5.3-Flash API services on Z.ai API Platform. We introduce GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. With 320B total parameters and just 18B active parameters, it outperforms GLM-5.2 across benchmarks and real-world workloads at one-tenth the price, while approaching Claude Opus 4.8 on coding and agentic benchmarks. GLM-5.3-Flash starts from a newly trained base model, with its architecture and training recipe redesigned around capability and efficiency. For the first time in the GLM series, we introduce a hybrid architecture combining sparse and linear…

Open weights mit 321.3B parameters 1,048,576 tokens transformers

Model · Image and text to text

Qwen3.6-35B-A3B-FP8

Qwen

Following the February release of the Qwen3.5 series, we're pleased to share the first open-weight variant of Qwen3.6. Built on direct feedback from the community, Qwen3.6 prioritizes stability and real-world utility, offering developers a more intuitive, responsive, and genuinely productive coding experience. This release delivers substantial upgrades, particularly in For more details, please refer to our blog post Qwen3.6-35B-A3B. Empty cells (--) indicate scores not available or not applicable. For streamlined integration, we recommend using Qwen3.6 via APIs. Below is a guide to use Qwen3.6 via OpenAI-compatible API. Qwen3.6 can be served via APIs with popular inference frameworks. In…

Open weights apache-2.0 36B parameters 262,144 tokens transformers