SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

Qwen3.8-Flash-Next-oQ2.7e-mtp

by Jun Kim Jundot/Qwen3.8-Flash-Next-oQ2.7e-mtp

Qwen3.8-Flash-Next-oQ2.7e-mtp is an open-weight model for image and text to text from Jun Kim, released under other. It has 180B parameters and a 262,144-token context. At 16-bit it needs about 432 GB of GPU memory, which fits on 2x MI325X from $4.00 an hour; at 4-bit, 108 GB on 1x MI300X from $1.85, at the lowest prices in the SAVRN Index.

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385).

Parameters180B
Context262,144
Weights85.2 GB
Licenseother
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve Qwen3.8-Flash-Next-oQ2.7e-mtp (180B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 360.0 GB 432.0 GB 2x MI325X (256 GB)
Vultr
$4.00 2x MI355X $5.18 · 3x MI300X $5.55
8-bit 180.0 GB 216.0 GB 1x MI325X (256 GB)
Vultr
$2.00 1x MI355X $2.59 · 2x MI300X $3.70
4-bit 90.0 GB 108.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x MI325X $2.00 · 1x MI355X $2.59

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 12, 2026.

Qwen3.8-Flash-Next-oQ2.7e-mtp on every accelerator the SAVRN Index prices, at every precision

Model Card

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385). A mixed-precision MLX checkpoint of Qwen/Qwen3.8-Flash-Next, an experimental preview of the architecture behind Qwen4: a mixture-of-experts vision-language model with 125B parameters and 6B activated, plus a 51B n-gram embedding and a 4B MTP module, that pairs Gated DeltaNet with Qwen Sparse Attention (QSA) and uses Gated Residual streams. It includes the language model, the n-gram embedding, the vision encoder and the multi-token prediction (MTP) head. The effective average is 3.305 bits/weight excluding the N-gram embedding table, or 3.787 bits/weight for the…

Excerpt from the card by Jun Kim, licensed other.

Configuration

Architecture
Qwen4ExpForConditionalGeneration
Context length (tokens)
262,144
Layers
48
Hidden size
2,560
Attention heads
24
Key/value heads
2
Head dimension
256
Vocabulary size
248,320
Experts
512
Experts active per token
10
Model type
qwen4_exp

Identity and Version

Repository
Jundot/Qwen3.8-Flash-Next-oQ2.7e-mtp
Publisher
Jun Kim
Task
Image and text to text
Modality
Image and text
Library
mlx
Parameters
180B parameters
Languages
mlx, oq, mtp
Revision
0e751a5005421ee87256efbb846674c7961c0982
First published
2026-10-12
Last updated
2026-10-12

Files and Weights

30 files, 85.2 GB in total. The weights are 17 files totalling 85.2 GB in safetensors.

Weights17 files · 85.2 GB
Configuration5 files · 749.3 KB
Tokenizer4 files · 22.9 MB
Documentation2 files · 5.9 KB
Other1 file · 9.0 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00017.safetensorsWeights5.1 GB 7d19bb223918
model-00002-of-00017.safetensorsWeights5.0 GB 4451478cf757
model-00003-of-00017.safetensorsWeights5.0 GB a3f43ee69264
model-00004-of-00017.safetensorsWeights5.0 GB 0d0e8868e906
model-00005-of-00017.safetensorsWeights5.0 GB 6ad381a090af
model-00006-of-00017.safetensorsWeights5.0 GB 6932d98dd404
model-00007-of-00017.safetensorsWeights5.0 GB a9e34de50375
model-00008-of-00017.safetensorsWeights5.2 GB 4e05f2eb3f1b
model-00009-of-00017.safetensorsWeights5.1 GB ac350e129ba6
model-00010-of-00017.safetensorsWeights5.2 GB ec04cbc042a8
model-00011-of-00017.safetensorsWeights5.0 GB fbf10f1184f9
model-00012-of-00017.safetensorsWeights5.1 GB 7af1aefe0213
model-00013-of-00017.safetensorsWeights5.3 GB eb3630faffad
model-00014-of-00017.safetensorsWeights5.3 GB 3841f5506447
model-00015-of-00017.safetensorsWeights5.1 GB 2feca100ab08
model-00016-of-00017.safetensorsWeights5.2 GB f7b2d9cb8497
model-00017-of-00017.safetensorsWeights3.6 GB 06013d9dbb2c
config.jsonConfiguration275.2 KB —
generation_config.jsonConfiguration202 B —
model.safetensors.index.jsonConfiguration405.2 KB —
oq_imatrix_report.jsonConfiguration68.3 KB —
preprocessor_config.jsonConfiguration390 B —
LICENSEDocumentation3.2 KB —
README.mdDocumentation2.7 KB —
chat_template.jinjaOther9.0 KB —
.gitattributesRepository1.6 KB —
merges.txtTokenizer3.4 MB —
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer17.9 KB —
vocab.jsonTokenizer6.7 MB —

License and Download

License
other
Access
Open weights, no gate
Download size
85.2 GB
Download from Jun Kim

Released by Jun Kim through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published85.2 GB
16-bit360.0 GB
8-bit180.0 GB
4-bit90.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.8-Flash-Next-oQ2.7e-mtp

How much GPU memory does Qwen3.8-Flash-Next-oQ2.7e-mtp need?

About 432 GB at 16-bit and 108 GB at 4-bit: the weights (180B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen3.8-Flash-Next-oQ2.7e-mtp on?

At 16-bit, 2x MI325X from $4.00 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Qwen3.8-Flash-Next-oQ2.7e-mtp released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen3.8-Flash-Next-oQ2.7e-mtp's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

Qwen3.8-Flash-Next

Qwen

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other 180B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.8-Flash-Next-Uncensored-NVFP4

OrcaRouter

This model has had its safety alignment substantially removed via abliteration (orthogonalizing the refusal direction out of the residual stream). It will comply with harmful, unethical, or illegal requests the original Qwen3.8-Flash-Next would refuse. Released strictly for legitimate research — interpretability, AI-safety / refusal-mechanism study, red-teaming, and robustness evaluation. You assume full responsibility for how you use it and everything it generates; add your own safety and moderation layers before any deployment. Use must comply with the Apache 2.0 License inherited from the base model and all applicable law. The authors accept no liability for misuse. - A Blackwell GPU…

Access requested at publisher apache-2.0 180B parameters transformers

Model · Image and text to text

Darwin-180B-RSI

FINAL_Bench

flagship of the Darwin family — #1 on AIME 2026, HMMT Feb 2026, GPQA Diamond, MMLU-Pro, MMMU-Pro, LEXam and LEXam-hard, and a model that gets better by learning from its own verified work. Scores as listed on the Hugging Face official benchmark leaderboards (self-reported by each model's publisher). = #1 on that leaderboard. "—" = not reported. Darwin is VIDRAFT's measurement-driven reasoning model family — 50+ official models, 400+ community derivatives, and now two places in the GPQA Diamond top 3 (Darwin-180B-RSI #1 · Darwin-397B-ZTC #3). Darwin treats a strong open model as a parent. It measures where the parent is weak, and strengthens exactly those parts — instead of re-training…

Open weights other 180B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.8-Flash-Next-MLX-oQ3-MTP

Robot Haus

A sensitivity-guided, mixed-precision MLX conversion of Qwen/Qwen3.8-Flash-Next, rebuilt directly from the official BF16 checkpoint with the model's matching native MTP block preserved. oQ3 uses a 3-bit affine base and spends additional precision on sensitive modules. Layer sensitivity was measured with a validated quantized calibration proxy, while every released weight was quantized from the official BF16 checkpoint. The result is a compact model with 746 higher-precision module overrides rather than a uniform 3-bit layout. The upstream tokenizer, current chat template, vision processor, generation configuration, licence, and native MTP configuration are retained. In a compatible oMLX…

Open weights other 180B parameters 262,144 tokens mlx

Model · Image and text to text

Qwen3.8-Flash-Next

Tai Hua

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other 180B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.8-Flash-Next

Ahmed

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other 180B parameters 262,144 tokens transformers