Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-CT-AutoRound

by Intel AI intel-ai/Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-CT-AutoRound

Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-CT-AutoRound is an open-weight model for text generation from Intel AI, released under other. It has 262,144-token context. Its published files total 180.2 GB. It draws 50 downloads a month.

This model is an MXFP4 (mixed MXFP4 experts / MXFP8 MTP experts, attention kept in BF16) model of Qwen/Qwen3.8-Flash-Next generated by intel/auto-round using RTN. Please follow the license of the original model.

Parameters—
Context262,144
Weights180.2 GB
Licenseother
AccessOpen weights
Monthly Downloads50

Model Card

This model is an MXFP4 (mixed MXFP4 experts / MXFP8 MTP experts, attention kept in BF16) model of Qwen/Qwen3.8-Flash-Next generated by intel/auto-round using RTN. Please follow the license of the original model. The model can produce factually incorrect output, and should not be relied on to produce factually accurate information. Because of the limitations of the pretrained model and the finetuning datasets, it is possible that this model could generate lewd, biased or otherwise offensive outputs. Therefore, before deploying any applications of the model, developers should perform safety testing. Users (both direct and downstream) should be made aware of the risks, biases and limitations…

Excerpt from the card by Intel AI, licensed other.

Configuration

Architecture
Qwen4ExpForConditionalGeneration
Context length (tokens)
262,144
Layers
48
Hidden size
2,560
Attention heads
24
Key/value heads
2
Head dimension
256
Vocabulary size
248,320
Experts
512
Experts active per token
10
Model type
qwen4_exp
Quantization
compressed-tensors

Identity and Version

Repository
intel-ai/Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-CT-AutoRound
Publisher
Intel AI
Task
Text generation
Modality
Text
Library
transformers
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
ccfd2288cefa386d9f442f162cc973b6e4607b2b
First published
2026-10-08
Last updated
2026-10-27

Files and Weights

145 files, 180.2 GB in total. The weights are 131 files totalling 180.2 GB in safetensors.

Weights131 files · 180.2 GB
Configuration6 files · 27.2 MB
Tokenizer4 files · 22.9 MB
Documentation2 files · 6.4 KB
Other1 file · 9.0 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00131.safetensorsWeights1.3 GB ba6fc69ebb6a
model-00002-of-00131.safetensorsWeights1.7 GB 0bed8ff8da43
model-00003-of-00131.safetensorsWeights1.0 GB 774f0ceeadb4
model-00004-of-00131.safetensorsWeights600.6 MB 803ab615728c
model-00005-of-00131.safetensorsWeights891.6 MB 50a6dcfdabe8
model-00006-of-00131.safetensorsWeights2.1 GB c54e479e5dd5
model-00007-of-00131.safetensorsWeights891.6 MB 3dedb6ae056c
model-00008-of-00131.safetensorsWeights1.7 GB babf49651372
model-00009-of-00131.safetensorsWeights3.2 GB 5cfda00bc2b9
model-00010-of-00131.safetensorsWeights3.2 GB 796123c9a8f6
model-00011-of-00131.safetensorsWeights3.2 GB 1bc599fc1da1
model-00012-of-00131.safetensorsWeights3.2 GB 83ac63250ced
model-00013-of-00131.safetensorsWeights3.2 GB db913a9562ad
model-00014-of-00131.safetensorsWeights3.2 GB eb250379b5f3
model-00015-of-00131.safetensorsWeights3.2 GB 498acf459ec4
model-00016-of-00131.safetensorsWeights3.2 GB b825725d1b5f
model-00017-of-00131.safetensorsWeights3.2 GB d35c8020cc9b
model-00018-of-00131.safetensorsWeights3.2 GB 17bda01aeb72
model-00019-of-00131.safetensorsWeights3.2 GB 043698fa7700
model-00020-of-00131.safetensorsWeights3.2 GB 685141e99f67
model-00021-of-00131.safetensorsWeights3.2 GB 901b8ceae044
model-00022-of-00131.safetensorsWeights3.2 GB b52c90571a8e
model-00023-of-00131.safetensorsWeights3.2 GB c5c655e92d4f
model-00024-of-00131.safetensorsWeights3.2 GB 1c436ffb96a6
model-00025-of-00131.safetensorsWeights3.2 GB d78776866a94
model-00026-of-00131.safetensorsWeights3.2 GB 3c6f78490cab
model-00027-of-00131.safetensorsWeights3.2 GB c7f289f96bb1
model-00028-of-00131.safetensorsWeights3.2 GB af3e14ee4897
model-00029-of-00131.safetensorsWeights3.2 GB e53f90f29d24
model-00030-of-00131.safetensorsWeights3.2 GB c6fe3e9059ae
model-00031-of-00131.safetensorsWeights3.2 GB a46d356bdc7c
model-00032-of-00131.safetensorsWeights3.2 GB fa1e7d8e6093
model-00033-of-00131.safetensorsWeights3.2 GB ed1c22222e3d
model-00034-of-00131.safetensorsWeights3.2 GB 07d6b203d8e1
model-00035-of-00131.safetensorsWeights3.2 GB 13e88bb39f27
model-00036-of-00131.safetensorsWeights3.2 GB 1788a59ddb22
model-00037-of-00131.safetensorsWeights3.2 GB 0ec39a8dd8de
model-00038-of-00131.safetensorsWeights3.2 GB 57f51fd53b2c
model-00039-of-00131.safetensorsWeights3.2 GB e9852f21cf78
model-00040-of-00131.safetensorsWeights484.7 MB 9ffa18a428cc
model-00041-of-00131.safetensorsWeights891.6 MB 28711cee9a9e
model-00042-of-00131.safetensorsWeights710.0 MB a13c0afb1374
model-00043-of-00131.safetensorsWeights891.6 MB 4049dbe73bdc
model-00044-of-00131.safetensorsWeights607.1 MB 75d6e37d3d0a
model-00045-of-00131.safetensorsWeights891.6 MB 1a2c7641ca53
model-00046-of-00131.safetensorsWeights600.6 MB 9473181156ef
model-00047-of-00131.safetensorsWeights891.6 MB 0b4b5304cc25
model-00048-of-00131.safetensorsWeights484.8 MB 8551a598054f
model-00049-of-00131.safetensorsWeights891.6 MB 27bfb61b5b5d
model-00050-of-00131.safetensorsWeights703.5 MB 892dc0010b9c
model-00051-of-00131.safetensorsWeights891.6 MB 55bf838f97d8
model-00052-of-00131.safetensorsWeights600.6 MB 9bb6c52c5e97
model-00053-of-00131.safetensorsWeights891.6 MB 741a01fedb10
model-00054-of-00131.safetensorsWeights607.1 MB cb45af69b498
model-00055-of-00131.safetensorsWeights891.6 MB 878470c23771
model-00056-of-00131.safetensorsWeights484.7 MB d7f51eb533c8
model-00057-of-00131.safetensorsWeights891.6 MB adffd2bb435b
model-00058-of-00131.safetensorsWeights710.0 MB 48357b874808
model-00059-of-00131.safetensorsWeights891.6 MB 730ea60877e1
model-00060-of-00131.safetensorsWeights484.7 MB 35362a6f717a
model-00061-of-00131.safetensorsWeights891.6 MB 84047e5eb699
model-00062-of-00131.safetensorsWeights1.8 GB 6ab6423e9f1f
model-00063-of-00131.safetensorsWeights1.5 GB ae5bc8277ce7
model-00064-of-00131.safetensorsWeights891.6 MB 411e28c51f71
model-00065-of-00131.safetensorsWeights600.6 MB 309ea5d1422e
model-00066-of-00131.safetensorsWeights891.6 MB 96268c15eab9
model-00067-of-00131.safetensorsWeights487.3 MB 135296bf0ac2
model-00068-of-00131.safetensorsWeights891.6 MB a3cc11e4d9da
model-00069-of-00131.safetensorsWeights703.5 MB db1e4f8b6281
model-00070-of-00131.safetensorsWeights891.6 MB 5ad4094d12a5
model-00071-of-00131.safetensorsWeights600.6 MB f1941bf4367d
model-00072-of-00131.safetensorsWeights891.6 MB 9139c94b89ff
model-00073-of-00131.safetensorsWeights607.1 MB 41e3e523a6ae
model-00074-of-00131.safetensorsWeights891.6 MB 94ad953158e7
model-00075-of-00131.safetensorsWeights484.7 MB cdfc4f9e12f4
model-00076-of-00131.safetensorsWeights891.6 MB b567130c78c8
model-00077-of-00131.safetensorsWeights706.8 MB c62be0627edd
model-00078-of-00131.safetensorsWeights891.6 MB 9eda11210c32
model-00079-of-00131.safetensorsWeights600.7 MB a882dfdd85c0
model-00080-of-00131.safetensorsWeights891.6 MB fbae54a7adf2
model-00081-of-00131.safetensorsWeights484.7 MB a899d06b0330
model-00082-of-00131.safetensorsWeights891.6 MB edd2f32c0116
model-00083-of-00131.safetensorsWeights703.5 MB 9879fe8c2f0b
model-00084-of-00131.safetensorsWeights891.6 MB 5e965f2567d4
model-00085-of-00131.safetensorsWeights484.7 MB 46e969fc37bd
model-00086-of-00131.safetensorsWeights891.6 MB 4149871320a4
model-00087-of-00131.safetensorsWeights710.0 MB e3d90d8ebbd2
model-00088-of-00131.safetensorsWeights891.6 MB 6e211f881152
model-00089-of-00131.safetensorsWeights607.1 MB 783b5e4630b2
model-00090-of-00131.safetensorsWeights891.6 MB 21d2e591fc23
model-00091-of-00131.safetensorsWeights603.9 MB c4c0c4bf1430
model-00092-of-00131.safetensorsWeights891.6 MB 0d54a680953d
model-00093-of-00131.safetensorsWeights484.7 MB 319c7b663cbb
model-00094-of-00131.safetensorsWeights891.6 MB 5c5442492681
model-00095-of-00131.safetensorsWeights703.5 MB 68ef569cbb9e
model-00096-of-00131.safetensorsWeights891.6 MB 4b504cb9af17
model-00097-of-00131.safetensorsWeights600.6 MB 1348f53fb210
model-00098-of-00131.safetensorsWeights891.6 MB 3ffe12862f45
model-00099-of-00131.safetensorsWeights600.6 MB 08694a6bb56d
model-00100-of-00131.safetensorsWeights891.6 MB 90522cd6dbd2
model-00101-of-00131.safetensorsWeights484.7 MB 47c7155a5817
model-00102-of-00131.safetensorsWeights891.6 MB 0fa8c0233fbb
model-00103-of-00131.safetensorsWeights703.5 MB 75825357a9d2
model-00104-of-00131.safetensorsWeights891.6 MB 9218a3e97acb
model-00105-of-00131.safetensorsWeights600.6 MB 5c9013a63013
model-00106-of-00131.safetensorsWeights891.6 MB 44ae04bbb84d
model-00107-of-00131.safetensorsWeights632.0 MB bea1c1d6f1e9
model-00108-of-00131.safetensorsWeights891.6 MB c9fd72678618
model-00109-of-00131.safetensorsWeights668.7 MB b4bba60aca84
model-00110-of-00131.safetensorsWeights891.6 MB e70f6cd38deb
model-00111-of-00131.safetensorsWeights484.7 MB 96ccafea6cd1
model-00112-of-00131.safetensorsWeights891.6 MB 0ec86ff51ee5
model-00113-of-00131.safetensorsWeights703.5 MB 8204952712dc
model-00114-of-00131.safetensorsWeights891.6 MB 1328f004bba6
model-00115-of-00131.safetensorsWeights600.6 MB 97f7c9bea63b
model-00116-of-00131.safetensorsWeights891.6 MB 0b0f005388b7
model-00117-of-00131.safetensorsWeights600.6 MB 5b67b70cab5b
model-00118-of-00131.safetensorsWeights891.6 MB 40b6401bc8e2
model-00119-of-00131.safetensorsWeights484.7 MB 41701698a9f4
model-00120-of-00131.safetensorsWeights891.6 MB 462ce9b5460f
model-00121-of-00131.safetensorsWeights716.6 MB 17487ba7d69a
model-00122-of-00131.safetensorsWeights891.6 MB 3736621b8cfa
model-00123-of-00131.safetensorsWeights600.6 MB b21c6afbf3d4
model-00124-of-00131.safetensorsWeights891.6 MB f6370f51f04d
model-00125-of-00131.safetensorsWeights497.8 MB b09d2aa3c1db
model-00126-of-00131.safetensorsWeights891.6 MB 889e2f9a963d
model-00127-of-00131.safetensorsWeights703.5 MB 76ed09a7399b
model-00128-of-00131.safetensorsWeights891.6 MB ff63f1e56f64
model-00129-of-00131.safetensorsWeights600.6 MB 4e64ba2abe7e
model-00130-of-00131.safetensorsWeights891.6 MB f2e9762655f9
model-00131-of-00131.safetensorsWeights891.6 MB 11deb7e4e698
config.jsonConfiguration5.2 MB —
generation_config.jsonConfiguration202 B —
model.safetensors.index.jsonConfiguration17.0 MB 6159efc141eb
preprocessor_config.jsonConfiguration390 B —
quantization_config.jsonConfiguration5.0 MB —
video_preprocessor_config.jsonConfiguration385 B —
LICENSEDocumentation3.2 KB —
README.mdDocumentation3.2 KB —
chat_template.jinjaOther9.0 KB —
.gitattributesRepository1.6 KB —
merges.txtTokenizer3.4 MB —
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer17.9 KB —
vocab.jsonTokenizer6.7 MB —

License and Download

License
other
Access
Open weights, no gate
Download size
180.2 GB
Download from Intel AI

Released by Intel AI through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published180.2 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-CT-AutoRound

What license is Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-CT-AutoRound released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen3.8-Flash-Next-MXFP4-BF16Attn-MXFP8MTP-CT-AutoRound's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp