SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

Kimi-K3-W4A16-RTN

by Aaron Beckley Fluffy/Kimi-K3-W4A16-RTN

Kimi K3 on a single NVIDIA A100 80GB. A weight-only quantisation of Moonshot AI's Kimi K3 (2.8T total / 104B activated parameters) that loads and generates on one A100 80GB GPU, with the routed experts held in host RAM.

Parameters2.7T
Context1,048,576
Weights1.4 TB
Licenseother
AccessOpen weights
Monthly Downloads

Runs On

What it takes to serve Kimi-K3-W4A16-RTN (2.7T parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 5478.3 GB 6574.0 GB More than one server of any accelerator the SAVRN Index prices.
8-bit 2739.2 GB 3287.0 GB More than one server of any accelerator the SAVRN Index prices.
4-bit 1369.6 GB 1643.5 GB 7x MI325X (256 GB)
Vultr
$14.00 6x MI355X $15.54 · 7x B300 $46.20

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

Kimi K3 on a single NVIDIA A100 80GB. A weight-only quantisation of Moonshot AI's Kimi K3 (2.8T total / 104B activated parameters) that loads and generates on one A100 80GB GPU, with the routed experts held in host RAM. No Ampere-targeted K3 build existed for vLLM, so this was made to fix that gap. Routed experts and attention re-encoded from MXFP4/BF16 into compressed-tensors pack-quantized, served by vLLM's Marlin kernels. Activations stay BF16 (W4A16 / W8A16). Round-to-nearest only — no calibration data, so no dataset is baked into these weights. Errors were measured by round-tripping each tensor through compressed-tensors' compress()/decompress(). Weight error is a proxy, not a quality…

Excerpt from the card by Aaron Beckley, licensed other.

Configuration

Architecture
KimiK3ForConditionalGeneration
Context length (tokens)
1,048,576
Layers
93
Hidden size
7,168
Feed-forward size
33,792
Attention heads
96
Key/value heads
96
Vocabulary size
163,840
Experts
896
Model type
kimi_k3

Identity and Version

Repository
Fluffy/Kimi-K3-W4A16-RTN
Publisher
Aaron Beckley
Task
Image and text to text
Modality
Image and text
Library
vllm
Parameters
2.7T parameters
Languages
moe, cpu-offload
Revision
afdd7ed3731c91a8152bb01fe210ee3f6fbb75fc
First published
2026-09-18
Last updated
2026-09-18

Files and Weights

205 files, 1.4 TB in total. The weights are 188 files totalling 1.4 TB in safetensors.

Weights188 files · 1.4 TB
Configuration12 files · 95.8 MB
Tokenizer2 files · 2.8 MB
Documentation2 files · 11.8 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-experts-00002-of-000096.safetensorsWeights14.8 GB 50a73e7b3d9b
model-experts-00003-of-000096.safetensorsWeights14.8 GB eafc43cbf305
model-experts-00004-of-000096.safetensorsWeights14.8 GB b4bdb4094d6e
model-experts-00005-of-000096.safetensorsWeights14.8 GB 8d62190d4b73
model-experts-00006-of-000096.safetensorsWeights14.8 GB ac86819d8d32
model-experts-00007-of-000096.safetensorsWeights14.8 GB 339981d966bb
model-experts-00008-of-000096.safetensorsWeights14.8 GB 98d73f589331
model-experts-00009-of-000096.safetensorsWeights14.8 GB a0be2df711fb
model-experts-00010-of-000096.safetensorsWeights14.8 GB 172e6bc2021f
model-experts-00011-of-000096.safetensorsWeights14.8 GB 3898473fb92b
model-experts-00012-of-000096.safetensorsWeights14.8 GB 406c321224b2
model-experts-00013-of-000096.safetensorsWeights14.8 GB d0dfaffd745a
model-experts-00014-of-000096.safetensorsWeights14.8 GB d9a6e2211bed
model-experts-00015-of-000096.safetensorsWeights14.8 GB 096d8cd3b608
model-experts-00016-of-000096.safetensorsWeights14.8 GB 05d0905246a1
model-experts-00017-of-000096.safetensorsWeights14.8 GB a59e1662c198
model-experts-00018-of-000096.safetensorsWeights14.8 GB 3de3e1841356
model-experts-00019-of-000096.safetensorsWeights14.8 GB 8c3bb80cf99f
model-experts-00020-of-000096.safetensorsWeights14.8 GB a13a1e2caff4
model-experts-00021-of-000096.safetensorsWeights14.8 GB 6222264c0c4f
model-experts-00022-of-000096.safetensorsWeights14.8 GB 02317d019dec
model-experts-00023-of-000096.safetensorsWeights14.8 GB a580edd2f7f1
model-experts-00024-of-000096.safetensorsWeights14.8 GB 319d837a2b71
model-experts-00025-of-000096.safetensorsWeights14.8 GB 6bb4913c1d34
model-experts-00026-of-000096.safetensorsWeights14.8 GB 6f2016a1666c
model-experts-00027-of-000096.safetensorsWeights14.8 GB 1a4fa906c63a
model-experts-00028-of-000096.safetensorsWeights14.8 GB c728f1ccacac
model-experts-00029-of-000096.safetensorsWeights14.8 GB 06b717644320
model-experts-00030-of-000096.safetensorsWeights14.8 GB 4e57b3026883
model-experts-00031-of-000096.safetensorsWeights14.8 GB 84d527e42caa
model-experts-00032-of-000096.safetensorsWeights14.8 GB 963962964b32
model-experts-00033-of-000096.safetensorsWeights14.8 GB 6e8ea39b949b
model-experts-00034-of-000096.safetensorsWeights14.8 GB 837742a87c57
model-experts-00035-of-000096.safetensorsWeights14.8 GB 2a539f92d989
model-experts-00036-of-000096.safetensorsWeights14.8 GB e7fb2a74dcaa
model-experts-00037-of-000096.safetensorsWeights14.8 GB f4947c1ad046
model-experts-00038-of-000096.safetensorsWeights14.8 GB 2daa2759ecf5
model-experts-00039-of-000096.safetensorsWeights14.8 GB ca785531c924
model-experts-00040-of-000096.safetensorsWeights14.8 GB 06894e3b46b9
model-experts-00041-of-000096.safetensorsWeights14.8 GB 3f1771be2c56
model-experts-00042-of-000096.safetensorsWeights14.8 GB 477a65eacc9b
model-experts-00043-of-000096.safetensorsWeights14.8 GB 6626714aeb0e
model-experts-00044-of-000096.safetensorsWeights14.8 GB 88bd4313526c
model-experts-00045-of-000096.safetensorsWeights14.8 GB c679f520f253
model-experts-00046-of-000096.safetensorsWeights14.8 GB 2d3b7c215c8d
model-experts-00047-of-000096.safetensorsWeights14.8 GB 723399d06258
model-experts-00048-of-000096.safetensorsWeights14.8 GB e2a2785e52e1
model-experts-00049-of-000096.safetensorsWeights14.8 GB f8c7475a3b2a
model-experts-00050-of-000096.safetensorsWeights14.8 GB 1c436f872c37
model-experts-00051-of-000096.safetensorsWeights14.8 GB ca5adf6bb1f3
model-experts-00052-of-000096.safetensorsWeights14.8 GB 761999fc4490
model-experts-00053-of-000096.safetensorsWeights14.8 GB c4db772ef63f
model-experts-00054-of-000096.safetensorsWeights14.8 GB af03fa311691
model-experts-00055-of-000096.safetensorsWeights14.8 GB 61c0e529b330
model-experts-00056-of-000096.safetensorsWeights14.8 GB e6e01829fc6c
model-experts-00057-of-000096.safetensorsWeights14.8 GB 8c84cfcbd6a1
model-experts-00058-of-000096.safetensorsWeights14.8 GB 65a432ff9f0a
model-experts-00059-of-000096.safetensorsWeights14.8 GB 8a3ba4d2d49f
model-experts-00060-of-000096.safetensorsWeights14.8 GB 5bb9f811681e
model-experts-00061-of-000096.safetensorsWeights14.8 GB 92603d049b1a
model-experts-00062-of-000096.safetensorsWeights14.8 GB bf87219821b2
model-experts-00063-of-000096.safetensorsWeights14.8 GB 3b61a94b663c
model-experts-00064-of-000096.safetensorsWeights14.8 GB e1f328a0a764
model-experts-00065-of-000096.safetensorsWeights14.8 GB f8edc3baef17
model-experts-00066-of-000096.safetensorsWeights14.8 GB 84c34b9077cb
model-experts-00067-of-000096.safetensorsWeights14.8 GB d8f0d58e91fa
model-experts-00068-of-000096.safetensorsWeights14.8 GB 6c710bcb68db
model-experts-00069-of-000096.safetensorsWeights14.8 GB 64da08579bdd
model-experts-00070-of-000096.safetensorsWeights14.8 GB 90ebee2093d9
model-experts-00071-of-000096.safetensorsWeights14.8 GB 15065759f3ac
model-experts-00072-of-000096.safetensorsWeights14.8 GB 1abf9423a8c9
model-experts-00073-of-000096.safetensorsWeights14.8 GB cfb9191c9afa
model-experts-00074-of-000096.safetensorsWeights14.8 GB 31342202ffa9
model-experts-00075-of-000096.safetensorsWeights14.8 GB 16737ef99cbf
model-experts-00076-of-000096.safetensorsWeights14.8 GB 409f7314bf17
model-experts-00077-of-000096.safetensorsWeights14.8 GB 376452e9cc33
model-experts-00078-of-000096.safetensorsWeights14.8 GB 916e6c8a2bb1
model-experts-00079-of-000096.safetensorsWeights14.8 GB 0667a5018beb
model-experts-00080-of-000096.safetensorsWeights14.8 GB 1d4c94886852
model-experts-00081-of-000096.safetensorsWeights14.8 GB f2646aa57438
model-experts-00082-of-000096.safetensorsWeights14.8 GB e1d35b56e867
model-experts-00083-of-000096.safetensorsWeights14.8 GB e5199b9f40f0
model-experts-00084-of-000096.safetensorsWeights14.8 GB 308ad38624b2
model-experts-00085-of-000096.safetensorsWeights14.8 GB bdfa7e1c71f0
model-experts-00086-of-000096.safetensorsWeights14.8 GB 5b2133f3ee21
model-experts-00087-of-000096.safetensorsWeights14.8 GB bfe32defde9f
model-experts-00088-of-000096.safetensorsWeights14.8 GB fb7ea535842e
model-experts-00089-of-000096.safetensorsWeights14.8 GB c4e7bc730132
model-experts-00090-of-000096.safetensorsWeights14.8 GB 3c7b5aa77f42
model-experts-00091-of-000096.safetensorsWeights14.8 GB 5567ef888aa5
model-experts-00092-of-000096.safetensorsWeights14.8 GB a69a4522c833
model-experts-00093-of-000096.safetensorsWeights14.8 GB 8c5ae1c4012f
model-other-00001-of-000096.safetensorsWeights1.7 GB 092901ff5388
model-other-00002-of-000096.safetensorsWeights477.3 MB c3041eaf0997
model-other-00003-of-000096.safetensorsWeights477.3 MB 63e1a91041f7
model-other-00004-of-000096.safetensorsWeights367.6 MB c67cd16d530f
model-other-00005-of-000096.safetensorsWeights477.3 MB 42b0481e88ea
model-other-00006-of-000096.safetensorsWeights477.3 MB 10ec62b36db6
model-other-00007-of-000096.safetensorsWeights477.3 MB 774c429af44a
model-other-00008-of-000096.safetensorsWeights367.6 MB e7172187fd22
model-other-00009-of-000096.safetensorsWeights477.3 MB 283b65d9b171
model-other-00010-of-000096.safetensorsWeights477.3 MB 1a7d20eeb2a8
model-other-00011-of-000096.safetensorsWeights477.3 MB 039da069cfb9
model-other-00012-of-000096.safetensorsWeights367.6 MB dee3c727c446
model-other-00013-of-000096.safetensorsWeights477.3 MB 602344318a78
model-other-00014-of-000096.safetensorsWeights477.3 MB 39960da10b01
model-other-00015-of-000096.safetensorsWeights477.3 MB 0ea1f5b33509
model-other-00016-of-000096.safetensorsWeights367.6 MB 6fc63733b79c
model-other-00017-of-000096.safetensorsWeights477.3 MB d800912e0d54
model-other-00018-of-000096.safetensorsWeights477.3 MB 23d137ab39f7
model-other-00019-of-000096.safetensorsWeights477.3 MB f67105705fb7
model-other-00020-of-000096.safetensorsWeights367.6 MB 87966db361ba
model-other-00021-of-000096.safetensorsWeights477.3 MB 828173f5682f
model-other-00022-of-000096.safetensorsWeights477.3 MB eee8d9931525
model-other-00023-of-000096.safetensorsWeights477.3 MB 55b47d2d27e6
model-other-00024-of-000096.safetensorsWeights367.6 MB 707457296f29
model-other-00025-of-000096.safetensorsWeights477.3 MB 1616abd910be
model-other-00026-of-000096.safetensorsWeights477.3 MB 0ea9a6db4e5d
model-other-00027-of-000096.safetensorsWeights477.3 MB 284be37ce06d
model-other-00028-of-000096.safetensorsWeights367.6 MB 1a8b91a516f8
model-other-00029-of-000096.safetensorsWeights477.3 MB ae264ac56ff3
model-other-00030-of-000096.safetensorsWeights477.3 MB b5915e05d420
model-other-00031-of-000096.safetensorsWeights477.3 MB 5a0c34f7e72c
model-other-00032-of-000096.safetensorsWeights367.6 MB 1ff42a53e1e6
model-other-00033-of-000096.safetensorsWeights477.3 MB 339621ed2905
model-other-00034-of-000096.safetensorsWeights477.3 MB dff0625c60ba
model-other-00035-of-000096.safetensorsWeights477.3 MB c6c9fc571177
model-other-00036-of-000096.safetensorsWeights367.6 MB d97bcca195e2
model-other-00037-of-000096.safetensorsWeights477.3 MB 33cf15aac647
model-other-00038-of-000096.safetensorsWeights477.3 MB 68c7227dbd16
model-other-00039-of-000096.safetensorsWeights477.3 MB ef3c7cf6f856
model-other-00040-of-000096.safetensorsWeights367.6 MB 4463358c94b9
model-other-00041-of-000096.safetensorsWeights477.3 MB d33e001719b3
model-other-00042-of-000096.safetensorsWeights477.3 MB 7dea45e3b4f2
model-other-00043-of-000096.safetensorsWeights477.3 MB 51df04ecb181
model-other-00044-of-000096.safetensorsWeights367.6 MB 82aa016ce61a
model-other-00045-of-000096.safetensorsWeights477.3 MB 386c4553dbac
model-other-00046-of-000096.safetensorsWeights477.3 MB 1667ac4d8e24
model-other-00047-of-000096.safetensorsWeights477.3 MB 259617a6428e
model-other-00048-of-000096.safetensorsWeights367.6 MB 86e743263307
model-other-00049-of-000096.safetensorsWeights477.3 MB 6a30a030daf5
model-other-00050-of-000096.safetensorsWeights477.3 MB 95fb157afe9a
model-other-00051-of-000096.safetensorsWeights477.3 MB 54d83a2c62c8
model-other-00052-of-000096.safetensorsWeights367.6 MB c3544856cbbc
model-other-00053-of-000096.safetensorsWeights477.3 MB 7954f6d58c88
model-other-00054-of-000096.safetensorsWeights477.3 MB 3263371db112
model-other-00055-of-000096.safetensorsWeights477.3 MB d10cfdc9900d
model-other-00056-of-000096.safetensorsWeights367.6 MB abd4b9ed8aed
model-other-00057-of-000096.safetensorsWeights477.3 MB 6482bd0ac697
model-other-00058-of-000096.safetensorsWeights477.3 MB 840d969ba225
model-other-00059-of-000096.safetensorsWeights477.3 MB 1a002932d2cb
model-other-00060-of-000096.safetensorsWeights367.6 MB 58d5b7df6eb7
model-other-00061-of-000096.safetensorsWeights477.3 MB 0dab48094e7f
model-other-00062-of-000096.safetensorsWeights477.3 MB f49b03f8fa46
model-other-00063-of-000096.safetensorsWeights477.3 MB fab71e924f4d
model-other-00064-of-000096.safetensorsWeights367.6 MB ddfb277a70af
model-other-00065-of-000096.safetensorsWeights477.3 MB 92e3deb6614a
model-other-00066-of-000096.safetensorsWeights477.3 MB 45b569162ca1
model-other-00067-of-000096.safetensorsWeights477.3 MB 2896ee1f72f2
model-other-00068-of-000096.safetensorsWeights367.6 MB 7bf18c845d2b
model-other-00069-of-000096.safetensorsWeights477.3 MB cb97f993dc08
model-other-00070-of-000096.safetensorsWeights477.3 MB 1c66a540f22d
model-other-00071-of-000096.safetensorsWeights477.3 MB b34a2dd84cb5
model-other-00072-of-000096.safetensorsWeights367.6 MB c0e514004721
model-other-00073-of-000096.safetensorsWeights477.3 MB 3ad3af556cfb
model-other-00074-of-000096.safetensorsWeights477.3 MB 0cecc784dbb9
model-other-00075-of-000096.safetensorsWeights477.3 MB 6a5f49812281
model-other-00076-of-000096.safetensorsWeights367.6 MB f2ffd88919bf
model-other-00077-of-000096.safetensorsWeights477.3 MB 9f19970ff7c4
model-other-00078-of-000096.safetensorsWeights477.3 MB c7bfef4541e9
model-other-00079-of-000096.safetensorsWeights477.3 MB 16217c9576b6
model-other-00080-of-000096.safetensorsWeights367.6 MB cb74a17ac8d4
model-other-00081-of-000096.safetensorsWeights477.3 MB 1cfe353e6f7f
model-other-00082-of-000096.safetensorsWeights477.3 MB d1e35a6ffdc4
model-other-00083-of-000096.safetensorsWeights477.3 MB 8a17d8c83ce6
model-other-00084-of-000096.safetensorsWeights367.6 MB 3cd0b8c24f9b
model-other-00085-of-000096.safetensorsWeights477.3 MB 8d4005e7ea8f
model-other-00086-of-000096.safetensorsWeights477.3 MB fe186e9b2ef8
model-other-00087-of-000096.safetensorsWeights477.3 MB 51a5521343f4
model-other-00088-of-000096.safetensorsWeights367.6 MB 74b319c362ae
model-other-00089-of-000096.safetensorsWeights477.3 MB 0344eceac2f3
model-other-00090-of-000096.safetensorsWeights477.3 MB ccee91d16ed7
model-other-00091-of-000096.safetensorsWeights477.3 MB 2e416605a174
model-other-00092-of-000096.safetensorsWeights367.6 MB 29de7501a438
model-other-00093-of-000096.safetensorsWeights367.6 MB ce5bafacb9da
model-other-00094-of-000096.safetensorsWeights4.7 GB 218812742e2c
model-other-00095-of-000096.safetensorsWeights92.3 MB d9fea5219730
model-other-00096-of-000096.safetensorsWeights802.4 MB 86101ec4f7a2
config.jsonConfiguration8.4 KB
configuration_kimi_k3.pyConfiguration11.3 KB
encoding_k3.pyConfiguration26.3 KB
generation_config.jsonConfiguration53 B
kimi_k3_processor.pyConfiguration7.7 KB
kimi_k3_vision_processing.pyConfiguration6.7 KB
media_utils.pyConfiguration13.8 KB
model.safetensors.index.jsonConfiguration95.6 MB ae00d6c52577
modeling_kimi_k3.pyConfiguration53.4 KB
modeling_kimi_linear.pyConfiguration51.5 KB
preprocessor_config.jsonConfiguration1.0 KB
tokenization_kimi.pyConfiguration16.1 KB
LICENSEDocumentation3.1 KB
README.mdDocumentation8.8 KB
.gitattributesRepository1.6 KB
tiktoken.modelTokenizer2.8 MB b6c497a7469b
tokenizer_config.jsonTokenizer3.5 KB

License and Download

License
other
Access
Open weights, no gate
Download size
1.4 TB
Download from Aaron Beckley

Released by Aaron Beckley through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published1.4 TB
16-bit5478.3 GB
8-bit2739.2 GB
4-bit1369.6 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Kimi-K3-W4A16-RTN

How much GPU memory does Kimi-K3-W4A16-RTN need?

About 6574 GB at 16-bit and 1643.5 GB at 4-bit: the weights (2.7T parameters) plus a working margin. A long context needs more.

What license is Kimi-K3-W4A16-RTN released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Kimi-K3-W4A16-RTN's context length?

1,048,576 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

Kimi-K3

Moonshot AI

Kimi K3 is an open-weight, native multimodal agentic model and our most capable model to date. It is a 2.8T-parameter model built on Kimi Delta Attention (KDA) and Attention Residuals (AttnRes), with native vision capabilities and a 1-million-token context window. It is the world's first open 3T-class model, designed for frontier intelligence across long-horizon coding, knowledge work, and reasoning. All Kimi K3 results are obtained with reasoning effort set to 'max' and temperature = 1.0. For single-step tasks, such as GPQA Diamond, HLE-Full, and vision benchmarks without tools, we set top-p = 0.95; for agentic tasks, we set top-p = 1.0. For HLE-Full, MMMU-Pro, CharXiv (RQ), MathVision…

Open weights other 2.8T parameters 1,048,576 tokens transformers

Model · Image and text to text

Qwen3.5-397B-A17B-FP8

Qwen

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. MathVision:our model’s score is…

Open weights apache-2.0 403.4B parameters 262,144 tokens transformers

Model · Image and text to text

GLM-5.3-Flash

Z.ai

Join our WeChat or Discord community. Check out the GLM-5.3-Flash blog and GLM-5 Technical report. Use GLM-5.3-Flash API services on Z.ai API Platform. We introduce GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. With 320B total parameters and just 18B active parameters, it outperforms GLM-5.2 across benchmarks and real-world workloads at one-tenth the price, while approaching Claude Opus 4.8 on coding and agentic benchmarks. GLM-5.3-Flash starts from a newly trained base model, with its architecture and training recipe redesigned around capability and efficiency. For the first time in the GLM series, we introduce a hybrid architecture combining sparse and linear…

Open weights mit 321.3B parameters 1,048,576 tokens transformers

Model · Image and text to text

Qwen3.8-Flash-Next

Qwen

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other 180B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.8-Flash-Next-Uncensored-NVFP4

OrcaRouter

This model has had its safety alignment substantially removed via abliteration (orthogonalizing the refusal direction out of the residual stream). It will comply with harmful, unethical, or illegal requests the original Qwen3.8-Flash-Next would refuse. Released strictly for legitimate research — interpretability, AI-safety / refusal-mechanism study, red-teaming, and robustness evaluation. You assume full responsibility for how you use it and everything it generates; add your own safety and moderation layers before any deployment. Use must comply with the Apache 2.0 License inherited from the base model and all applicable law. The authors accept no liability for misuse. - A Blackwell GPU…

Access requested at publisher apache-2.0 180B parameters transformers

Model · Image and text to text

Qwen3.8-Flash-Next-MLX-oQ3-MTP

Robot Haus

A sensitivity-guided, mixed-precision MLX conversion of Qwen/Qwen3.8-Flash-Next, rebuilt directly from the official BF16 checkpoint with the model's matching native MTP block preserved. oQ3 uses a 3-bit affine base and spends additional precision on sensitive modules. Layer sensitivity was measured with a validated quantized calibration proxy, while every released weight was quantized from the official BF16 checkpoint. The result is a compact model with 746 higher-precision module overrides rather than a uniform 3-bit layout. The upstream tokenizer, current chat template, vision processor, generation configuration, licence, and native MTP configuration are retained. In a compatible oMLX…

Open weights other 180B parameters 262,144 tokens mlx