Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-PLEMXFP8-CT-AutoRound

by Intel AI intel-ai/Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-PLEMXFP8-CT-AutoRound

Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-PLEMXFP8-CT-AutoRound is an open-weight model for text generation from Intel AI, released under other. It has 262,144-token context. Its published files total 130.6 GB. It draws 63 downloads a month.

This model is an MXFP4 (mixed MXFP4 experts / MXFP8 MTP experts and PLE table) model of Qwen/Qwen3.8-Flash-Next generated by intel/auto-round using RTN. Please follow the license of the original model.

Parameters—
Context262,144
Weights130.6 GB
Licenseother
AccessOpen weights
Monthly Downloads63

Model Card

This model is an MXFP4 (mixed MXFP4 experts / MXFP8 MTP experts and PLE table) model of Qwen/Qwen3.8-Flash-Next generated by intel/auto-round using RTN. Please follow the license of the original model. The model can produce factually incorrect output, and should not be relied on to produce factually accurate information. Because of the limitations of the pretrained model and the finetuning datasets, it is possible that this model could generate lewd, biased or otherwise offensive outputs. Therefore, before deploying any applications of the model, developers should perform safety testing. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the…

Excerpt from the card by Intel AI, licensed other.

Configuration

Architecture
Qwen4ExpForConditionalGeneration
Context length (tokens)
262,144
Layers
48
Hidden size
2,560
Attention heads
24
Key/value heads
2
Head dimension
256
Vocabulary size
248,320
Experts
512
Experts active per token
10
Model type
qwen4_exp
Quantization
compressed-tensors

Identity and Version

Repository
intel-ai/Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-PLEMXFP8-CT-AutoRound
Publisher
Intel AI
Task
Text generation
Modality
Text
Library
transformers
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
accb825b5e8ead2d8077a4ca8d4f65f21d31f15c
First published
2026-10-08
Last updated
2026-10-27

Files and Weights

154 files, 130.6 GB in total. The weights are 131 files totalling 130.6 GB in safetensors.

Weights131 files · 130.6 GB
Configuration6 files · 27.2 MB
Tokenizer4 files · 22.9 MB
Documentation2 files · 6.4 KB
Other10 files · 47.1 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00131.safetensorsWeights1.3 GB ba6fc69ebb6a
model-00002-of-00131.safetensorsWeights1.7 GB 0bed8ff8da43
model-00003-of-00131.safetensorsWeights1.0 GB 774f0ceeadb4
model-00004-of-00131.safetensorsWeights600.6 MB 803ab615728c
model-00005-of-00131.safetensorsWeights891.6 MB 50a6dcfdabe8
model-00006-of-00131.safetensorsWeights1.3 GB b9c268b76db2
model-00007-of-00131.safetensorsWeights891.6 MB 3dedb6ae056c
model-00008-of-00131.safetensorsWeights967.3 MB d80cdb70d695
model-00009-of-00131.safetensorsWeights1.7 GB 82581f317aad
model-00010-of-00131.safetensorsWeights1.7 GB fcb0aa0be625
model-00011-of-00131.safetensorsWeights1.7 GB 1d0aac3fa33a
model-00012-of-00131.safetensorsWeights1.7 GB 3d6e44786ef5
model-00013-of-00131.safetensorsWeights1.7 GB 2cf58eef1d47
model-00014-of-00131.safetensorsWeights1.7 GB d51f2cb9bf94
model-00015-of-00131.safetensorsWeights1.7 GB fc1158dc10e5
model-00016-of-00131.safetensorsWeights1.7 GB 3158ed30b125
model-00017-of-00131.safetensorsWeights1.7 GB fb4abc23d7fa
model-00018-of-00131.safetensorsWeights1.7 GB 6843758949b7
model-00019-of-00131.safetensorsWeights1.7 GB 527e46095027
model-00020-of-00131.safetensorsWeights1.7 GB ad20b5d3536e
model-00021-of-00131.safetensorsWeights1.7 GB 99ca9936ab9a
model-00022-of-00131.safetensorsWeights1.7 GB a02f16485fa8
model-00023-of-00131.safetensorsWeights1.7 GB 990fe197d47b
model-00024-of-00131.safetensorsWeights1.7 GB bd822641ec5d
model-00025-of-00131.safetensorsWeights1.7 GB 69e4fa731581
model-00026-of-00131.safetensorsWeights1.7 GB f41a77ae617a
model-00027-of-00131.safetensorsWeights1.7 GB 6948ba84dfe1
model-00028-of-00131.safetensorsWeights1.7 GB 9b9df6e11530
model-00029-of-00131.safetensorsWeights1.7 GB fd4a8f926f7a
model-00030-of-00131.safetensorsWeights1.7 GB 963ed1aa4e12
model-00031-of-00131.safetensorsWeights1.7 GB ef47ee587dd9
model-00032-of-00131.safetensorsWeights1.7 GB f4271fc000e1
model-00033-of-00131.safetensorsWeights1.7 GB f68b95379bb9
model-00034-of-00131.safetensorsWeights1.7 GB e7fb43f46db8
model-00035-of-00131.safetensorsWeights1.7 GB 5a437c74ab2c
model-00036-of-00131.safetensorsWeights1.7 GB b0025794d351
model-00037-of-00131.safetensorsWeights1.7 GB 4f2e613fd97f
model-00038-of-00131.safetensorsWeights1.7 GB 7fdbb73f2c6e
model-00039-of-00131.safetensorsWeights1.7 GB e5217272c093
model-00040-of-00131.safetensorsWeights484.7 MB 9ffa18a428cc
model-00041-of-00131.safetensorsWeights891.6 MB 28711cee9a9e
model-00042-of-00131.safetensorsWeights710.0 MB a13c0afb1374
model-00043-of-00131.safetensorsWeights891.6 MB 4049dbe73bdc
model-00044-of-00131.safetensorsWeights607.1 MB 75d6e37d3d0a
model-00045-of-00131.safetensorsWeights891.6 MB 1a2c7641ca53
model-00046-of-00131.safetensorsWeights600.6 MB 9473181156ef
model-00047-of-00131.safetensorsWeights891.6 MB 0b4b5304cc25
model-00048-of-00131.safetensorsWeights484.8 MB 8551a598054f
model-00049-of-00131.safetensorsWeights891.6 MB 27bfb61b5b5d
model-00050-of-00131.safetensorsWeights703.5 MB 892dc0010b9c
model-00051-of-00131.safetensorsWeights891.6 MB 55bf838f97d8
model-00052-of-00131.safetensorsWeights600.6 MB 9bb6c52c5e97
model-00053-of-00131.safetensorsWeights891.6 MB 741a01fedb10
model-00054-of-00131.safetensorsWeights607.1 MB cb45af69b498
model-00055-of-00131.safetensorsWeights891.6 MB 878470c23771
model-00056-of-00131.safetensorsWeights484.7 MB d7f51eb533c8
model-00057-of-00131.safetensorsWeights891.6 MB adffd2bb435b
model-00058-of-00131.safetensorsWeights710.0 MB 48357b874808
model-00059-of-00131.safetensorsWeights891.6 MB 730ea60877e1
model-00060-of-00131.safetensorsWeights484.7 MB 35362a6f717a
model-00061-of-00131.safetensorsWeights891.6 MB 84047e5eb699
model-00062-of-00131.safetensorsWeights1.8 GB 6ab6423e9f1f
model-00063-of-00131.safetensorsWeights1.5 GB ae5bc8277ce7
model-00064-of-00131.safetensorsWeights891.6 MB 411e28c51f71
model-00065-of-00131.safetensorsWeights600.6 MB 309ea5d1422e
model-00066-of-00131.safetensorsWeights891.6 MB 96268c15eab9
model-00067-of-00131.safetensorsWeights487.3 MB 135296bf0ac2
model-00068-of-00131.safetensorsWeights891.6 MB a3cc11e4d9da
model-00069-of-00131.safetensorsWeights703.5 MB db1e4f8b6281
model-00070-of-00131.safetensorsWeights891.6 MB 5ad4094d12a5
model-00071-of-00131.safetensorsWeights600.6 MB f1941bf4367d
model-00072-of-00131.safetensorsWeights891.6 MB 9139c94b89ff
model-00073-of-00131.safetensorsWeights607.1 MB 41e3e523a6ae
model-00074-of-00131.safetensorsWeights891.6 MB 94ad953158e7
model-00075-of-00131.safetensorsWeights484.7 MB cdfc4f9e12f4
model-00076-of-00131.safetensorsWeights891.6 MB b567130c78c8
model-00077-of-00131.safetensorsWeights706.8 MB c62be0627edd
model-00078-of-00131.safetensorsWeights891.6 MB 9eda11210c32
model-00079-of-00131.safetensorsWeights600.7 MB a882dfdd85c0
model-00080-of-00131.safetensorsWeights891.6 MB fbae54a7adf2
model-00081-of-00131.safetensorsWeights484.7 MB a899d06b0330
model-00082-of-00131.safetensorsWeights891.6 MB edd2f32c0116
model-00083-of-00131.safetensorsWeights703.5 MB 9879fe8c2f0b
model-00084-of-00131.safetensorsWeights891.6 MB 5e965f2567d4
model-00085-of-00131.safetensorsWeights484.7 MB 46e969fc37bd
model-00086-of-00131.safetensorsWeights891.6 MB 4149871320a4
model-00087-of-00131.safetensorsWeights710.0 MB e3d90d8ebbd2
model-00088-of-00131.safetensorsWeights891.6 MB 6e211f881152
model-00089-of-00131.safetensorsWeights607.1 MB 783b5e4630b2
model-00090-of-00131.safetensorsWeights891.6 MB 21d2e591fc23
model-00091-of-00131.safetensorsWeights603.9 MB c4c0c4bf1430
model-00092-of-00131.safetensorsWeights891.6 MB 0d54a680953d
model-00093-of-00131.safetensorsWeights484.7 MB 319c7b663cbb
model-00094-of-00131.safetensorsWeights891.6 MB 5c5442492681
model-00095-of-00131.safetensorsWeights703.5 MB 68ef569cbb9e
model-00096-of-00131.safetensorsWeights891.6 MB 4b504cb9af17
model-00097-of-00131.safetensorsWeights600.6 MB 1348f53fb210
model-00098-of-00131.safetensorsWeights891.6 MB 3ffe12862f45
model-00099-of-00131.safetensorsWeights600.6 MB 08694a6bb56d
model-00100-of-00131.safetensorsWeights891.6 MB 90522cd6dbd2
model-00101-of-00131.safetensorsWeights484.7 MB 47c7155a5817
model-00102-of-00131.safetensorsWeights891.6 MB 0fa8c0233fbb
model-00103-of-00131.safetensorsWeights703.5 MB 75825357a9d2
model-00104-of-00131.safetensorsWeights891.6 MB 9218a3e97acb
model-00105-of-00131.safetensorsWeights600.6 MB 5c9013a63013
model-00106-of-00131.safetensorsWeights891.6 MB 44ae04bbb84d
model-00107-of-00131.safetensorsWeights632.0 MB bea1c1d6f1e9
model-00108-of-00131.safetensorsWeights891.6 MB c9fd72678618
model-00109-of-00131.safetensorsWeights668.7 MB b4bba60aca84
model-00110-of-00131.safetensorsWeights891.6 MB e70f6cd38deb
model-00111-of-00131.safetensorsWeights484.7 MB 96ccafea6cd1
model-00112-of-00131.safetensorsWeights891.6 MB 0ec86ff51ee5
model-00113-of-00131.safetensorsWeights703.5 MB 8204952712dc
model-00114-of-00131.safetensorsWeights891.6 MB 1328f004bba6
model-00115-of-00131.safetensorsWeights600.6 MB 97f7c9bea63b
model-00116-of-00131.safetensorsWeights891.6 MB 0b0f005388b7
model-00117-of-00131.safetensorsWeights600.6 MB 5b67b70cab5b
model-00118-of-00131.safetensorsWeights891.6 MB 40b6401bc8e2
model-00119-of-00131.safetensorsWeights484.7 MB 41701698a9f4
model-00120-of-00131.safetensorsWeights891.6 MB 462ce9b5460f
model-00121-of-00131.safetensorsWeights716.6 MB 17487ba7d69a
model-00122-of-00131.safetensorsWeights891.6 MB 3736621b8cfa
model-00123-of-00131.safetensorsWeights600.6 MB b21c6afbf3d4
model-00124-of-00131.safetensorsWeights891.6 MB f6370f51f04d
model-00125-of-00131.safetensorsWeights497.8 MB b09d2aa3c1db
model-00126-of-00131.safetensorsWeights891.6 MB 889e2f9a963d
model-00127-of-00131.safetensorsWeights703.5 MB 76ed09a7399b
model-00128-of-00131.safetensorsWeights891.6 MB ff63f1e56f64
model-00129-of-00131.safetensorsWeights600.6 MB 4e64ba2abe7e
model-00130-of-00131.safetensorsWeights891.6 MB f2e9762655f9
model-00131-of-00131.safetensorsWeights891.6 MB 11deb7e4e698
config.jsonConfiguration5.1 MB —
generation_config.jsonConfiguration202 B —
model.safetensors.index.jsonConfiguration17.0 MB 0c3c7e6daac4
preprocessor_config.jsonConfiguration390 B —
quantization_config.jsonConfiguration5.0 MB —
video_preprocessor_config.jsonConfiguration385 B —
LICENSEDocumentation3.2 KB —
README.mdDocumentation3.2 KB —
chat_template.jinjaOther9.0 KB —
patches/apply_qwen38fn_ple_mxfp8.shOther2.4 KB —
patches/apply_v41_ct_ignore_prefix.shOther2.9 KB —
patches/apply_v41_ct_mxfp8_is_bmm.shOther2.4 KB —
patches/auto-round/0001-switch-blockwise-mxfp8-to-OCP-mxfp8.patchOther1.6 KB —
patches/auto-round/0002-ignore-dsv41-.engram.embed.patchOther6.6 KB —
patches/dsv4-ct-mxfp8-oproj.patchOther5.0 KB —
patches/qwen38fn-ple-mxfp8.patchOther12.9 KB —
patches/v41-ct-ignore-prefix.patchOther2.6 KB —
patches/v41-ct-mxfp8-is-bmm.patchOther1.6 KB —
.gitattributesRepository1.6 KB —
merges.txtTokenizer3.4 MB —
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer17.9 KB —
vocab.jsonTokenizer6.7 MB —

License and Download

License
other
Access
Open weights, no gate
Download size
130.6 GB
Download from Intel AI

Released by Intel AI through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published130.6 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-PLEMXFP8-CT-AutoRound

What license is Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-PLEMXFP8-CT-AutoRound released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-PLEMXFP8-CT-AutoRound's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp