Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Qwen3.8-Flash-Next-W8A8-DYNAMIC-300i

by Matt Davis matteiuspi/Qwen3.8-Flash-Next-W8A8-DYNAMIC-300i

Qwen3.8-Flash-Next-W8A8-DYNAMIC-300i is an open-weight model for text generation from Matt Davis, released under other. It has 262,144-token context. Its published files total 240.1 GB.

This repository contains an Ascend ModelSlim W8A8DYNAMIC conversion of pinned at revision It targets two Atlas 300I Duo cards, exposed as four Ascend 310P3 devices, with tensor parallelism across all four devices.

Parameters—
Context262,144
Weights240.0 GB
Licenseother
AccessOpen weights
Monthly Downloads—

Model Card

This repository contains an Ascend ModelSlim W8A8DYNAMIC conversion of pinned at revision It targets two Atlas 300I Duo cards, exposed as four Ascend 310P3 devices, with tensor parallelism across all four devices. The checkpoint preserves the base model's Qwen4 experimental architecture: 48 decoder layers, 512 routed experts, hybrid Gated DeltaNet/Qwen Sparse Attention, PLE n-gram embeddings, a vision encoder, and MTP weights. The current Ascend serving path has only been exercised for text generation. Multimodal execution is not claimed as supported, and MTP remains provisional pending the quality comparison and final public runtime freeze. The conversion used Ascend ModelSlim's…

Excerpt from the card by Matt Davis, licensed other.

Configuration

Architecture
Qwen4ExpForConditionalGeneration
Context length (tokens)
262,144
Layers
48
Hidden size
2,560
Attention heads
24
Key/value heads
2
Head dimension
256
Vocabulary size
248,320
Experts
512
Experts active per token
10
Model type
qwen4_exp

Identity and Version

Repository
matteiuspi/Qwen3.8-Flash-Next-W8A8-DYNAMIC-300i
Publisher
Matt Davis
Task
Text generation
Modality
Text
Library
vllm
Parameters
Not stated by the source
Languages
moe
Revision
ba32d36e90d958a06480b3d79e0c82ede704875a
First published
2026-09-23
Last updated
2026-09-26

Files and Weights

270 files, 240.1 GB in total. The weights are 254 files totalling 240.0 GB in safetensors.

Weights254 files · 240.0 GB
Configuration8 files · 47.8 MB
Tokenizer4 files · 22.9 MB
Documentation2 files · 16.6 KB
Other1 file · 9.0 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
quant_model_weights-00001-of-00254.safetensorsWeights1.1 GB 3ad42b331477
quant_model_weights-00002-of-00254.safetensorsWeights1.1 GB f3eb553189a2
quant_model_weights-00003-of-00254.safetensorsWeights1.1 GB 3f5650306585
quant_model_weights-00004-of-00254.safetensorsWeights1.1 GB 151bd25efb34
quant_model_weights-00005-of-00254.safetensorsWeights1.1 GB a654739b33ab
quant_model_weights-00006-of-00254.safetensorsWeights1.1 GB 7f0347377c04
quant_model_weights-00007-of-00254.safetensorsWeights1.1 GB 8a6c182681c4
quant_model_weights-00008-of-00254.safetensorsWeights1.1 GB cb752b63bd62
quant_model_weights-00009-of-00254.safetensorsWeights1.1 GB e94a5ec41591
quant_model_weights-00010-of-00254.safetensorsWeights1.1 GB d06732bd6040
quant_model_weights-00011-of-00254.safetensorsWeights1.1 GB ae80ff9e1546
quant_model_weights-00012-of-00254.safetensorsWeights1.1 GB 5bda889a09d5
quant_model_weights-00013-of-00254.safetensorsWeights1.1 GB f713e9095591
quant_model_weights-00014-of-00254.safetensorsWeights1.1 GB 149f499f7ef2
quant_model_weights-00015-of-00254.safetensorsWeights1.1 GB 4a9c474a3412
quant_model_weights-00016-of-00254.safetensorsWeights1.1 GB 14facc265eff
quant_model_weights-00017-of-00254.safetensorsWeights1.1 GB dea7606359bf
quant_model_weights-00018-of-00254.safetensorsWeights1.1 GB 0d0093c5a8af
quant_model_weights-00019-of-00254.safetensorsWeights1.1 GB bf6d16d34b6c
quant_model_weights-00020-of-00254.safetensorsWeights1.1 GB 718c2098aa96
quant_model_weights-00021-of-00254.safetensorsWeights1.1 GB ccfa7dd6c37d
quant_model_weights-00022-of-00254.safetensorsWeights1.1 GB 46abf04d059a
quant_model_weights-00023-of-00254.safetensorsWeights1.1 GB 86d38587b139
quant_model_weights-00024-of-00254.safetensorsWeights1.1 GB 71dfb10770b7
quant_model_weights-00025-of-00254.safetensorsWeights1.1 GB e879ec853195
quant_model_weights-00026-of-00254.safetensorsWeights1.1 GB b4cc0ae782e9
quant_model_weights-00027-of-00254.safetensorsWeights1.1 GB 4eb37df34484
quant_model_weights-00028-of-00254.safetensorsWeights1.1 GB a299cd2b172c
quant_model_weights-00029-of-00254.safetensorsWeights1.1 GB db5a28d9acff
quant_model_weights-00030-of-00254.safetensorsWeights1.1 GB cd643ae7e665
quant_model_weights-00031-of-00254.safetensorsWeights1.1 GB 275bc1008be8
quant_model_weights-00032-of-00254.safetensorsWeights1.1 GB a76e3efac0ee
quant_model_weights-00033-of-00254.safetensorsWeights1.1 GB d24f6aebabb1
quant_model_weights-00034-of-00254.safetensorsWeights1.1 GB c2af7cd06ec7
quant_model_weights-00035-of-00254.safetensorsWeights1.1 GB b3f7e807a615
quant_model_weights-00036-of-00254.safetensorsWeights1.1 GB e75599016039
quant_model_weights-00037-of-00254.safetensorsWeights1.1 GB d5153d888993
quant_model_weights-00038-of-00254.safetensorsWeights1.1 GB 8281111d74a9
quant_model_weights-00039-of-00254.safetensorsWeights1.1 GB d2196014e77e
quant_model_weights-00040-of-00254.safetensorsWeights1.1 GB a32e138ffe70
quant_model_weights-00041-of-00254.safetensorsWeights1.1 GB f1bf47645b1d
quant_model_weights-00042-of-00254.safetensorsWeights1.1 GB 365dce18597b
quant_model_weights-00043-of-00254.safetensorsWeights1.1 GB 86a4c6472557
quant_model_weights-00044-of-00254.safetensorsWeights1.1 GB 492703924e56
quant_model_weights-00045-of-00254.safetensorsWeights1.1 GB 5e0b63438dba
quant_model_weights-00046-of-00254.safetensorsWeights1.1 GB 43d3218605cc
quant_model_weights-00047-of-00254.safetensorsWeights1.1 GB 365d993e95f7
quant_model_weights-00048-of-00254.safetensorsWeights1.1 GB bedb1310a6f4
quant_model_weights-00049-of-00254.safetensorsWeights1.1 GB 45c2ee20b023
quant_model_weights-00050-of-00254.safetensorsWeights1.1 GB 67067f7b7c8f
quant_model_weights-00051-of-00254.safetensorsWeights1.1 GB e24daef6456e
quant_model_weights-00052-of-00254.safetensorsWeights1.1 GB c947021754de
quant_model_weights-00053-of-00254.safetensorsWeights1.1 GB 3c1970586807
quant_model_weights-00054-of-00254.safetensorsWeights1.1 GB 056803d62c86
quant_model_weights-00055-of-00254.safetensorsWeights1.1 GB 7843f82b21cb
quant_model_weights-00056-of-00254.safetensorsWeights1.1 GB 95d297228268
quant_model_weights-00057-of-00254.safetensorsWeights1.1 GB 7b7630cddaf7
quant_model_weights-00058-of-00254.safetensorsWeights1.1 GB 86827fdfb097
quant_model_weights-00059-of-00254.safetensorsWeights1.1 GB 100a414a0014
quant_model_weights-00060-of-00254.safetensorsWeights1.1 GB 02a0201ca1b5
quant_model_weights-00061-of-00254.safetensorsWeights1.1 GB fdcc2a1fce27
quant_model_weights-00062-of-00254.safetensorsWeights1.1 GB 5eb9032555bb
quant_model_weights-00063-of-00254.safetensorsWeights1.1 GB ec4fb9f5ad98
quant_model_weights-00064-of-00254.safetensorsWeights1.1 GB 4a4ac7998ab6
quant_model_weights-00065-of-00254.safetensorsWeights1.1 GB 530d76bd8d1f
quant_model_weights-00066-of-00254.safetensorsWeights1.1 GB a028855ae51d
quant_model_weights-00067-of-00254.safetensorsWeights1.1 GB a9c97c337fa4
quant_model_weights-00068-of-00254.safetensorsWeights1.1 GB 403960880b70
quant_model_weights-00069-of-00254.safetensorsWeights1.1 GB 791c6a032b13
quant_model_weights-00070-of-00254.safetensorsWeights1.1 GB 79d91d059b6b
quant_model_weights-00071-of-00254.safetensorsWeights1.1 GB da67bd61c162
quant_model_weights-00072-of-00254.safetensorsWeights1.1 GB 6fe8a33402d5
quant_model_weights-00073-of-00254.safetensorsWeights1.1 GB ca1efe028c04
quant_model_weights-00074-of-00254.safetensorsWeights1.1 GB f080b2bf0dda
quant_model_weights-00075-of-00254.safetensorsWeights1.1 GB 59fb88d03868
quant_model_weights-00076-of-00254.safetensorsWeights1.1 GB 10ffeaf548a9
quant_model_weights-00077-of-00254.safetensorsWeights1.1 GB e9e804fa99a0
quant_model_weights-00078-of-00254.safetensorsWeights1.1 GB 8c5ecbcfd2a6
quant_model_weights-00079-of-00254.safetensorsWeights1.1 GB d753955102f8
quant_model_weights-00080-of-00254.safetensorsWeights1.1 GB a25fc251ac59
quant_model_weights-00081-of-00254.safetensorsWeights1.1 GB d24e9b62ed03
quant_model_weights-00082-of-00254.safetensorsWeights1.1 GB 151c125bc022
quant_model_weights-00083-of-00254.safetensorsWeights1.1 GB 5af50913af26
quant_model_weights-00084-of-00254.safetensorsWeights1.1 GB 660ea7501449
quant_model_weights-00085-of-00254.safetensorsWeights1.1 GB 528b912b23be
quant_model_weights-00086-of-00254.safetensorsWeights1.1 GB c500a664fb94
quant_model_weights-00087-of-00254.safetensorsWeights1.1 GB ddb2c95f8dc5
quant_model_weights-00088-of-00254.safetensorsWeights1.1 GB aba17b24b0ad
quant_model_weights-00089-of-00254.safetensorsWeights1.1 GB afa3a119d8cd
quant_model_weights-00090-of-00254.safetensorsWeights1.1 GB b2098ade1c92
quant_model_weights-00091-of-00254.safetensorsWeights1.1 GB 14c7db5e6c86
quant_model_weights-00092-of-00254.safetensorsWeights1.1 GB 90d01cea580f
quant_model_weights-00093-of-00254.safetensorsWeights1.1 GB 903611df604a
quant_model_weights-00094-of-00254.safetensorsWeights1.1 GB d68ded9fa9dc
quant_model_weights-00095-of-00254.safetensorsWeights1.1 GB 995cca14c397
quant_model_weights-00096-of-00254.safetensorsWeights1.1 GB 1fad60b3c1ab
quant_model_weights-00097-of-00254.safetensorsWeights1.1 GB 801260fac4db
quant_model_weights-00098-of-00254.safetensorsWeights1.1 GB c9dc0a2f8881
quant_model_weights-00099-of-00254.safetensorsWeights1.1 GB 254442afe442
quant_model_weights-00100-of-00254.safetensorsWeights1.1 GB 2596f58ac611
quant_model_weights-00101-of-00254.safetensorsWeights1.1 GB 759bcc2a6a52
quant_model_weights-00102-of-00254.safetensorsWeights1.1 GB c6e4843dca76
quant_model_weights-00103-of-00254.safetensorsWeights1.1 GB 6b42043828ab
quant_model_weights-00104-of-00254.safetensorsWeights1.1 GB a108fae1fac8
quant_model_weights-00105-of-00254.safetensorsWeights1.1 GB ae32ff7d679c
quant_model_weights-00106-of-00254.safetensorsWeights1.1 GB 4719366ad473
quant_model_weights-00107-of-00254.safetensorsWeights1.1 GB c9543b65949c
quant_model_weights-00108-of-00254.safetensorsWeights1.1 GB 35bc1f501315
quant_model_weights-00109-of-00254.safetensorsWeights1.1 GB 4461f2e87977
quant_model_weights-00110-of-00254.safetensorsWeights1.1 GB b9f8b86e328b
quant_model_weights-00111-of-00254.safetensorsWeights1.1 GB b8dd4201f5fe
quant_model_weights-00112-of-00254.safetensorsWeights1.1 GB 1882d8e1bc55
quant_model_weights-00113-of-00254.safetensorsWeights1.1 GB 963fa4d4e7fb
quant_model_weights-00114-of-00254.safetensorsWeights1.1 GB e4cc767fef7a
quant_model_weights-00115-of-00254.safetensorsWeights1.1 GB f188b475e74b
quant_model_weights-00116-of-00254.safetensorsWeights1.1 GB 218dccc98b2c
quant_model_weights-00117-of-00254.safetensorsWeights1.1 GB 0493fc83aa15
quant_model_weights-00118-of-00254.safetensorsWeights1.0 GB 5d085010060c
quant_model_weights-00119-of-00254.safetensorsWeights1.1 GB 24f42060bd5a
quant_model_weights-00120-of-00254.safetensorsWeights1.1 GB 4767ac736ab5
quant_model_weights-00121-of-00254.safetensorsWeights800.0 MB 4345b6c2da36
quant_model_weights-00122-of-00254.safetensorsWeights800.0 MB 8cb654a0212f
quant_model_weights-00123-of-00254.safetensorsWeights800.0 MB d0ec5ca8944a
quant_model_weights-00124-of-00254.safetensorsWeights800.0 MB ecc2a2f8366f
quant_model_weights-00125-of-00254.safetensorsWeights800.0 MB ebd25bc3821a
quant_model_weights-00126-of-00254.safetensorsWeights800.0 MB 9c9a0dd8d0dd
quant_model_weights-00127-of-00254.safetensorsWeights800.0 MB 4acbd84a2f95
quant_model_weights-00128-of-00254.safetensorsWeights800.0 MB 719ef8f3693c
quant_model_weights-00129-of-00254.safetensorsWeights800.0 MB 1306c3ad6689
quant_model_weights-00130-of-00254.safetensorsWeights800.0 MB a98ac22fd95b
quant_model_weights-00131-of-00254.safetensorsWeights800.0 MB b3f5e8e4936e
quant_model_weights-00132-of-00254.safetensorsWeights800.0 MB fe93e84ee6c6
quant_model_weights-00133-of-00254.safetensorsWeights800.0 MB b5ccb748a493
quant_model_weights-00134-of-00254.safetensorsWeights800.0 MB b411cc177a68
quant_model_weights-00135-of-00254.safetensorsWeights800.0 MB b43fd530ecb1
quant_model_weights-00136-of-00254.safetensorsWeights800.0 MB 7f4b8a88045a
quant_model_weights-00137-of-00254.safetensorsWeights800.0 MB 5758b53320bc
quant_model_weights-00138-of-00254.safetensorsWeights800.0 MB 7e8def4da5dd
quant_model_weights-00139-of-00254.safetensorsWeights800.0 MB 9b0eae3fa082
quant_model_weights-00140-of-00254.safetensorsWeights800.0 MB 70ad6a035c3e
quant_model_weights-00141-of-00254.safetensorsWeights800.0 MB 97485757bd12
quant_model_weights-00142-of-00254.safetensorsWeights800.0 MB b796ae272458
quant_model_weights-00143-of-00254.safetensorsWeights800.0 MB 8c004c6155e8
quant_model_weights-00144-of-00254.safetensorsWeights800.0 MB ae3c978dc0c7
quant_model_weights-00145-of-00254.safetensorsWeights800.0 MB bfd4f1052541
quant_model_weights-00146-of-00254.safetensorsWeights800.0 MB 9128fe755599
quant_model_weights-00147-of-00254.safetensorsWeights800.0 MB 65324fff1d84
quant_model_weights-00148-of-00254.safetensorsWeights800.0 MB a553905805e7
quant_model_weights-00149-of-00254.safetensorsWeights800.0 MB c384d658865f
quant_model_weights-00150-of-00254.safetensorsWeights800.0 MB ee8fb631b82e
quant_model_weights-00151-of-00254.safetensorsWeights800.0 MB 2c2eebde96cb
quant_model_weights-00152-of-00254.safetensorsWeights800.0 MB d0353720e2fc
quant_model_weights-00153-of-00254.safetensorsWeights800.0 MB c63af54630ef
quant_model_weights-00154-of-00254.safetensorsWeights800.0 MB 06ef56fbc2bf
quant_model_weights-00155-of-00254.safetensorsWeights800.0 MB 62fd79fc7321
quant_model_weights-00156-of-00254.safetensorsWeights800.0 MB e04910811523
quant_model_weights-00157-of-00254.safetensorsWeights800.0 MB fb5d4050028f
quant_model_weights-00158-of-00254.safetensorsWeights800.0 MB 8b08115c2611
quant_model_weights-00159-of-00254.safetensorsWeights800.0 MB dc743e9a87e3
quant_model_weights-00160-of-00254.safetensorsWeights800.0 MB d564cc45453c
quant_model_weights-00161-of-00254.safetensorsWeights800.0 MB f537ecac5cc7
quant_model_weights-00162-of-00254.safetensorsWeights800.0 MB 31447638e07b
quant_model_weights-00163-of-00254.safetensorsWeights800.0 MB 45138d1d2ac3
quant_model_weights-00164-of-00254.safetensorsWeights800.0 MB 661252682476
quant_model_weights-00165-of-00254.safetensorsWeights800.0 MB 24a8a5524939
quant_model_weights-00166-of-00254.safetensorsWeights800.0 MB cffef2acf22c
quant_model_weights-00167-of-00254.safetensorsWeights800.0 MB 5572f7962a72
quant_model_weights-00168-of-00254.safetensorsWeights800.0 MB 55fb4d76bb46
quant_model_weights-00169-of-00254.safetensorsWeights800.0 MB b550b08f74d5
quant_model_weights-00170-of-00254.safetensorsWeights800.0 MB a885edb10824
quant_model_weights-00171-of-00254.safetensorsWeights800.0 MB ec206f40a982
quant_model_weights-00172-of-00254.safetensorsWeights800.0 MB 25cbdc1b3725
quant_model_weights-00173-of-00254.safetensorsWeights800.0 MB 2c6a0804acc4
quant_model_weights-00174-of-00254.safetensorsWeights800.0 MB ae6f483ef0f2
quant_model_weights-00175-of-00254.safetensorsWeights800.0 MB 41574306cfe2
quant_model_weights-00176-of-00254.safetensorsWeights800.0 MB 9789291d95c8
quant_model_weights-00177-of-00254.safetensorsWeights800.0 MB a55bc31d8c63
quant_model_weights-00178-of-00254.safetensorsWeights800.0 MB d8e5f146ebe7
quant_model_weights-00179-of-00254.safetensorsWeights800.0 MB a2d9504235a3
quant_model_weights-00180-of-00254.safetensorsWeights800.0 MB 6baac0065d0c
quant_model_weights-00181-of-00254.safetensorsWeights800.0 MB 554dac3a30c0
quant_model_weights-00182-of-00254.safetensorsWeights800.0 MB 80538fa52bb5
quant_model_weights-00183-of-00254.safetensorsWeights800.0 MB f8b78b427b28
quant_model_weights-00184-of-00254.safetensorsWeights800.0 MB 7505cd61ed3f
quant_model_weights-00185-of-00254.safetensorsWeights800.0 MB 2da9896707cf
quant_model_weights-00186-of-00254.safetensorsWeights800.0 MB a43987e7d7fe
quant_model_weights-00187-of-00254.safetensorsWeights800.0 MB 4427f6207eb1
quant_model_weights-00188-of-00254.safetensorsWeights800.0 MB 39cf9b710a30
quant_model_weights-00189-of-00254.safetensorsWeights800.0 MB 4dd09aaf1d2e
quant_model_weights-00190-of-00254.safetensorsWeights800.0 MB 522f9e74544a
quant_model_weights-00191-of-00254.safetensorsWeights800.0 MB e05c9519816f
quant_model_weights-00192-of-00254.safetensorsWeights800.0 MB 1a34dd36bccc
quant_model_weights-00193-of-00254.safetensorsWeights800.0 MB f938c2f2b757
quant_model_weights-00194-of-00254.safetensorsWeights800.0 MB 69006e992ae0
quant_model_weights-00195-of-00254.safetensorsWeights800.0 MB 36a291280fa6
quant_model_weights-00196-of-00254.safetensorsWeights800.0 MB 68fc78f2b040
quant_model_weights-00197-of-00254.safetensorsWeights800.0 MB 1e83e0c7c31e
quant_model_weights-00198-of-00254.safetensorsWeights800.0 MB 32431198a311
quant_model_weights-00199-of-00254.safetensorsWeights800.0 MB 8344ed1601fd
quant_model_weights-00200-of-00254.safetensorsWeights800.0 MB af059664b7ef
quant_model_weights-00201-of-00254.safetensorsWeights800.0 MB a93956c3f1cd
quant_model_weights-00202-of-00254.safetensorsWeights800.0 MB 666a91ec9a5e
quant_model_weights-00203-of-00254.safetensorsWeights800.0 MB c5e9776eb53e
quant_model_weights-00204-of-00254.safetensorsWeights800.0 MB 9371052084eb
quant_model_weights-00205-of-00254.safetensorsWeights800.0 MB e247a28fc194
quant_model_weights-00206-of-00254.safetensorsWeights800.0 MB 0a962b5c7218
quant_model_weights-00207-of-00254.safetensorsWeights800.0 MB 6c2ccd8d31c9
quant_model_weights-00208-of-00254.safetensorsWeights800.0 MB f9572381dc79
quant_model_weights-00209-of-00254.safetensorsWeights800.0 MB 7e0e72afdfe2
quant_model_weights-00210-of-00254.safetensorsWeights800.0 MB f2a3e503a3f8
quant_model_weights-00211-of-00254.safetensorsWeights800.0 MB fdb620c260bf
quant_model_weights-00212-of-00254.safetensorsWeights800.0 MB 83d75714a92f
quant_model_weights-00213-of-00254.safetensorsWeights800.0 MB dbb11e47dfaf
quant_model_weights-00214-of-00254.safetensorsWeights800.0 MB eb73e337e081
quant_model_weights-00215-of-00254.safetensorsWeights800.0 MB e2c19198f520
quant_model_weights-00216-of-00254.safetensorsWeights800.0 MB d2c9df318c93
quant_model_weights-00217-of-00254.safetensorsWeights800.0 MB d48298343a06
quant_model_weights-00218-of-00254.safetensorsWeights800.0 MB 3a3d155c0ebc
quant_model_weights-00219-of-00254.safetensorsWeights800.0 MB 5409f6e4eb0e
quant_model_weights-00220-of-00254.safetensorsWeights800.0 MB edcde07c54f4
quant_model_weights-00221-of-00254.safetensorsWeights800.0 MB 3a4d8fb6915e
quant_model_weights-00222-of-00254.safetensorsWeights800.0 MB 18a9c7346c3c
quant_model_weights-00223-of-00254.safetensorsWeights800.0 MB d0aa0d24b524
quant_model_weights-00224-of-00254.safetensorsWeights800.0 MB dc8ec7832424
quant_model_weights-00225-of-00254.safetensorsWeights800.0 MB 539619099419
quant_model_weights-00226-of-00254.safetensorsWeights800.0 MB f4e33f0758ca
quant_model_weights-00227-of-00254.safetensorsWeights800.0 MB e3f1f61a1c10
quant_model_weights-00228-of-00254.safetensorsWeights800.0 MB 54272ce85cee
quant_model_weights-00229-of-00254.safetensorsWeights800.0 MB 5def5145c17b
quant_model_weights-00230-of-00254.safetensorsWeights800.0 MB 5d62936b5ed0
quant_model_weights-00231-of-00254.safetensorsWeights800.0 MB 9471c9261bfd
quant_model_weights-00232-of-00254.safetensorsWeights800.0 MB bb3049068892
quant_model_weights-00233-of-00254.safetensorsWeights800.0 MB 88fa9fd80814
quant_model_weights-00234-of-00254.safetensorsWeights800.0 MB 822c2b2ac773
quant_model_weights-00235-of-00254.safetensorsWeights800.0 MB ae9708543303
quant_model_weights-00236-of-00254.safetensorsWeights800.0 MB 196f7aee0694
quant_model_weights-00237-of-00254.safetensorsWeights800.0 MB 2b2c2555fc8f
quant_model_weights-00238-of-00254.safetensorsWeights800.0 MB 02f3c41bc8ab
quant_model_weights-00239-of-00254.safetensorsWeights800.0 MB ba69ef635f59
quant_model_weights-00240-of-00254.safetensorsWeights800.0 MB 730ccd5ee438
quant_model_weights-00241-of-00254.safetensorsWeights800.0 MB 7b61f269c2cd
quant_model_weights-00242-of-00254.safetensorsWeights800.0 MB 036a188e6671
quant_model_weights-00243-of-00254.safetensorsWeights800.0 MB 9d46964793a7
quant_model_weights-00244-of-00254.safetensorsWeights800.0 MB 14524e4d8dd9
quant_model_weights-00245-of-00254.safetensorsWeights800.0 MB 6309c4803924
quant_model_weights-00246-of-00254.safetensorsWeights800.0 MB bf3b745dbfaa
quant_model_weights-00247-of-00254.safetensorsWeights1.1 GB 7333fef88dd4
quant_model_weights-00248-of-00254.safetensorsWeights708.6 MB b2b62c5171fa
quant_model_weights-00249-of-00254.safetensorsWeights1.3 GB 7b562483a5f2
quant_model_weights-00250-of-00254.safetensorsWeights1.1 GB db9a91537abc
quant_model_weights-00251-of-00254.safetensorsWeights1.7 GB 0e3b535c68d1
quant_model_weights-00252-of-00254.safetensorsWeights3.4 GB 512aa586698d
quant_model_weights-00253-of-00254.safetensorsWeights39.4 MB a6b2bcecf02c
quant_model_weights-00254-of-00254.safetensorsWeights1.3 GB c7d7281a954c
PROVENANCE.jsonConfiguration4.9 KB —
calibration_manifest.jsonConfiguration8.5 KB —
config.jsonConfiguration4.0 KB —
generation_config.jsonConfiguration202 B —
preprocessor_config.jsonConfiguration390 B —
quant_model_description.jsonConfiguration20.1 MB 412dbd5f3b85
quant_model_weights.safetensors.index.jsonConfiguration27.7 MB 79ba339223eb
video_preprocessor_config.jsonConfiguration385 B —
LICENSEDocumentation3.2 KB —
README.mdDocumentation13.4 KB —
chat_template.jinjaOther9.0 KB —
.gitattributesRepository1.7 KB —
merges.txtTokenizer3.4 MB —
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer17.9 KB —
vocab.jsonTokenizer6.7 MB —

License and Download

License
other
Access
Open weights, no gate
Download size
240.0 GB
Download from Matt Davis

Released by Matt Davis through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published240.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.8-Flash-Next-W8A8-DYNAMIC-300i

What license is Qwen3.8-Flash-Next-W8A8-DYNAMIC-300i released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen3.8-Flash-Next-W8A8-DYNAMIC-300i's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers