Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58

by LOKSUN LOKSUN-158/SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58

SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58 is an open-weight model for text generation from LOKSUN, released under other. It has 111.1B parameters and a 262,144-token context. At 16-bit it needs about 266.6 GB of GPU memory, which fits on 1x MI355X from $2.59 an hour; at 4-bit, 66.6 GB on 1x MI300X from $1.85, at the lowest prices in the SAVRN Index. It draws 71 downloads a month.

一个在 Apple M3 Max / 128GB 统一内存上手工量化出的 Qwen3.8-Flash-Next(qwen4exp 架构,180B 级 MoE:125B 主干 + 51B n-gram 表 + 4B MTP 投机头)的 mlx-serve 混合位宽包:常驻约 60GB,无审查源,带视觉塔。 - 基座模型:Qwen 官方 Qwen3.8-Flash-Next;原始权重:社区团队 orcarouter 的无审查 BF16 包(335.3 GiB / 131 分片,逐文件 sha256 验收…

Parameters111.1B
Context262,144
Weights96.2 GB
Licenseother
AccessOpen weights
Monthly Downloads71

Runs On

What it takes to serve SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58 (111.1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 222.1 GB 266.6 GB 1x MI355X (288 GB)
Vultr
$2.59 2x MI300X $3.70 · 2x MI325X $4.00
8-bit 111.1 GB 133.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x MI325X $2.00 · 1x MI355X $2.59
4-bit 55.5 GB 66.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58 on every accelerator the SAVRN Index prices, at every precision

Model Card

一个在 Apple M3 Max / 128GB 统一内存上手工量化出的 Qwen3.8-Flash-Next(qwen4exp 架构,180B 级 MoE:125B 主干 + 51B n-gram 表 + 4B MTP 投机头)的 mlx-serve 混合位宽包:常驻约 60GB,无审查源,带视觉塔。 - 基座模型:Qwen 官方 Qwen3.8-Flash-Next;原始权重:社区团队 orcarouter 的无审查 BF16 包(335.3 GiB / 131 分片,逐文件 sha256 验收 132/132 通过) - 量化工具链:mlx-serve 仓库自带产线(imatrix 校准采集 → 贪心位宽分配 → 混合宽度转换 → 留出窗口打分),感谢上游作者 - 本包作者做的四件事:用自己的 AI 会话日志做校准语料(三个 agent 工具的真实流量 + 官方通用语料,按内容 sha1 去重 26.11%,密钥/凭证脱敏)、逐层贪定位宽配方、跑完整产线、做质量与业务验收 - 卡片样式沿用 mlx-serve 生态包卡片惯例(模板参考 ddalcu 上游卡片),读数全部替换为 M3 Max 128GB 本机实测 整库约 92GB:权重与视觉塔 59.83GB(索引载荷口径,100 个编号分片 + model-vision.safetensors)+ 独立 n-gram 表 32,000,153,976 字节(ngramtable.bin)+ 9 个配置/文档文件。 生产运行口径(日常 DSH agent 会话,2026-10-06 17:24 起 51 小时):…

Excerpt from the card by LOKSUN, licensed other.

Configuration

Architecture
Qwen4ExpForConditionalGeneration
Context length (tokens)
262,144
Layers
48
Hidden size
2,560
Attention heads
24
Key/value heads
2
Head dimension
256
Vocabulary size
248,320
Experts
512
Experts active per token
10
Model type
qwen4_exp

Identity and Version

Repository
LOKSUN-158/SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58
Publisher
LOKSUN
Task
Text generation
Modality
Text
Library
mlx-serve
Parameters
111.1B parameters
Languages
mlx-serve, mlx, moe
Revision
0b3f69fee65a566d03c8086a1d407a3f8b036127
First published
2026-10-08
Last updated
2026-10-10

Files and Weights

113 files, 96.3 GB in total. The weights are 102 files totalling 96.2 GB in bin, safetensors.

Weights102 files · 96.2 GB
Configuration3 files · 309.6 KB
Tokenizer4 files · 22.9 MB
Documentation2 files · 8.8 KB
Other1 file · 9.0 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001.safetensorsWeights57.9 MB e985aec658bd
model-00002.safetensorsWeights734.0 MB f6eaf1521181
model-00003.safetensorsWeights430.1 MB e780fc009284
model-00004.safetensorsWeights734.0 MB 0ab2ed7d9e73
model-00005.safetensorsWeights398.9 MB 73d655c8bf32
model-00006.safetensorsWeights58.0 MB 5e569dcf66f9
model-00007.safetensorsWeights734.0 MB 2e23eddd08f2
model-00008.safetensorsWeights382.9 MB c19b2ee3340f
model-00009.safetensorsWeights943.7 MB bb4d5892f09b
model-00010.safetensorsWeights474.5 MB eb649708601d
model-00011.safetensorsWeights734.0 MB c06c38feccc5
model-00012.safetensorsWeights432.7 MB bb44c0f2ec33
model-00013.safetensorsWeights734.0 MB b8078adfc50b
model-00014.safetensorsWeights430.1 MB 476857a4440c
model-00015.safetensorsWeights734.0 MB 6cfff9183c89
model-00016.safetensorsWeights383.0 MB e77f0a335578
model-00017.safetensorsWeights734.0 MB 2e4b802650cc
model-00018.safetensorsWeights471.9 MB 51d772714692
model-00019.safetensorsWeights734.0 MB 2fc7056c8ce7
model-00020.safetensorsWeights430.1 MB dafe8f1402e2
model-00021.safetensorsWeights734.0 MB bd253816aa3b
model-00022.safetensorsWeights432.7 MB c81df1b8984d
model-00023.safetensorsWeights734.0 MB 2501f5664020
model-00024.safetensorsWeights382.9 MB 921e686f9868
model-00025.safetensorsWeights943.7 MB cfb7a3319a2e
model-00026.safetensorsWeights474.5 MB 51152c1b1e55
model-00027.safetensorsWeights734.0 MB 55fae9e3a098
model-00028.safetensorsWeights382.9 MB a13a58dac959
model-00029.safetensorsWeights990.9 MB 31af0a2402eb
model-00030.safetensorsWeights943.7 MB b2ba3f4a1765
model-00031.safetensorsWeights901.9 MB 43089b41b4c4
model-00032.safetensorsWeights943.7 MB 1cb5c119e334
model-00033.safetensorsWeights430.1 MB 45b15290f501
model-00034.safetensorsWeights943.7 MB 795e5b664e3a
model-00035.safetensorsWeights384.0 MB 6f5e54d716eb
model-00036.safetensorsWeights943.7 MB 1173a347d3e8
model-00037.safetensorsWeights471.9 MB 4205830ae341
model-00038.safetensorsWeights943.7 MB c5052570d6e1
model-00039.safetensorsWeights430.1 MB 0d6d31f9f586
model-00040.safetensorsWeights943.7 MB 8df87dabcd0b
model-00041.safetensorsWeights432.7 MB 46f035c935fe
model-00042.safetensorsWeights943.7 MB f2b380805a55
model-00043.safetensorsWeights382.9 MB a31ea43ad541
model-00044.safetensorsWeights943.7 MB 86b9d9f497ae
model-00045.safetensorsWeights473.2 MB 94c73dffc401
model-00046.safetensorsWeights943.7 MB 5d8b9c31d25d
model-00047.safetensorsWeights430.1 MB 7e2b807da761
model-00048.safetensorsWeights734.0 MB 1ee54c933c2a
model-00049.safetensorsWeights382.9 MB f7a341a15cb3
model-00050.safetensorsWeights734.0 MB 7e157dadffdc
model-00051.safetensorsWeights471.9 MB 4ad72b3cca77
model-00052.safetensorsWeights943.7 MB 52bb07074131
model-00053.safetensorsWeights382.9 MB 5953504271db
model-00054.safetensorsWeights734.0 MB ca83fc50edbf
model-00055.safetensorsWeights474.5 MB 53983e201417
model-00056.safetensorsWeights943.7 MB ed57acc9e1ee
model-00057.safetensorsWeights432.7 MB bcdb3f88e0ff
model-00058.safetensorsWeights943.7 MB cdf49044e2bb
model-00059.safetensorsWeights431.4 MB 1971e3ceb0e5
model-00060.safetensorsWeights943.7 MB 3e905d0b80c3
model-00061.safetensorsWeights487.8 MB 5472d0b799f1
model-00062.safetensorsWeights943.7 MB 4ad31b620fce
model-00063.safetensorsWeights471.9 MB c8f908ee6186
model-00064.safetensorsWeights943.7 MB 41979eea5f3b
model-00065.safetensorsWeights430.1 MB 6467bcea6f1b
model-00066.safetensorsWeights943.7 MB 8651b7051cca
model-00067.safetensorsWeights430.1 MB eac9ba2b27e6
model-00068.safetensorsWeights943.7 MB ce7b2721daa6
model-00069.safetensorsWeights382.9 MB debf7c74deb6
model-00070.safetensorsWeights734.0 MB f97cc326d191
model-00071.safetensorsWeights471.9 MB 8f90c22b48ab
model-00072.safetensorsWeights734.0 MB ed1826878119
model-00073.safetensorsWeights430.1 MB 5fd9c64c5e42
model-00074.safetensorsWeights734.0 MB 6a887b52bf29
model-00075.safetensorsWeights442.8 MB edfbccc5d50a
model-00076.safetensorsWeights734.0 MB 3b085601621b
model-00077.safetensorsWeights457.8 MB d5b5d88898f8
model-00078.safetensorsWeights734.0 MB 4313d33f317d
model-00079.safetensorsWeights382.9 MB 77638619a942
model-00080.safetensorsWeights734.0 MB 08fa86597a77
model-00081.safetensorsWeights471.9 MB d47dab05f21a
model-00082.safetensorsWeights734.0 MB 4baa81e7df15
model-00083.safetensorsWeights430.1 MB df6d32fc69e9
model-00084.safetensorsWeights734.0 MB f8e6fe6d6f38
model-00085.safetensorsWeights430.1 MB 02e2e1ed9ea0
model-00086.safetensorsWeights943.7 MB 25919426ac98
model-00087.safetensorsWeights487.8 MB 7decee052e4a
model-00088.safetensorsWeights943.7 MB acfbf021fe1f
model-00089.safetensorsWeights582.1 MB 1ee960a38611
model-00090.safetensorsWeights943.7 MB a597965005dc
model-00091.safetensorsWeights430.1 MB c1997bd122a6
model-00092.safetensorsWeights734.0 MB 5c5599854fca
model-00093.safetensorsWeights388.2 MB 19e3bc38c5aa
model-00094.safetensorsWeights734.0 MB d03e7365fd36
model-00095.safetensorsWeights471.9 MB 9b6d2f595e96
model-00096.safetensorsWeights734.0 MB 227a9b7f5818
model-00097.safetensorsWeights430.1 MB bfd840ef7793
model-00098.safetensorsWeights943.7 MB 17b96b84a9a2
model-00099.safetensorsWeights735.1 MB 1a34764e6b10
model-00100.safetensorsWeights516.5 MB f9b462957456
model-vision.safetensorsWeights897.9 MB bba0b8dd7d32
ngram_table.binWeights32.0 GB c8ab74bc3434
config.jsonConfiguration4.4 KB —
generation_config.jsonConfiguration202 B —
model.safetensors.index.jsonConfiguration305.0 KB —
LICENSEDocumentation3.2 KB —
README.mdDocumentation5.5 KB —
chat_template.jinjaOther9.0 KB —
.gitattributesRepository1.6 KB —
merges.txtTokenizer3.4 MB —
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer17.9 KB —
vocab.jsonTokenizer6.7 MB —

License and Download

License
other
Access
Open weights, no gate
Download size
96.2 GB
Download from LOKSUN

Released by LOKSUN through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published96.2 GB
16-bit222.1 GB
8-bit111.1 GB
4-bit55.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58

How much GPU memory does SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58 need?

About 266.6 GB at 16-bit and 66.6 GB at 4-bit: the weights (111.1B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58 on?

At 16-bit, 1x MI355X from $2.59 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58 released under?

other, as its publisher declares it. Read the license text before commercial use.

What is SamQuant-Qwen3.8-Flash-Next-Uncensored-MLX-Serve-Mix-C58's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

gpt-oss-120b

OpenAI

Welcome to the gpt-oss series, OpenAI’s open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases. We’re releasing two flavors of these open models: - gpt-oss-120b — for production, general purpose, high reasoning use cases that fit into a single 80GB GPU (like NVIDIA H100 or AMD MI300X) (117B parameters with 5.1B active parameters) - gpt-oss-20b — for lower latency, and local or specialized use cases (21B parameters with 3.6B active parameters) Both models were trained on our harmony response format and should only be used with the harmony format as it will not work correctly otherwise. You can use gpt-oss-120b and gpt-oss-20b with Transformers.…

Open weights apache-2.0 116.8B parameters 131,072 tokens transformers

Abliterated Jarrelscy ARVQ / NVFP4 hybrid of XiaomiMiMo/MiMo-V2.6-Pro-RL. Thinking on/off is a request flag. Same weights. You choose per call. Thinking-off is the 100% gate. Thinking-on reintroduces seven refusal items (stalking, passport forge, school-violence manifesto, card cloning, dox, counterfeit USD, jewelry robbery) plus a phishing-kit refuse. Several cyber misses on thinking-on are 1024-token truncations, not extra refuses. Harmless probes stay clean in both modes. This model has had safety refusals removed. Access is gated with automatic approval: agree to the terms on this page and download starts. See RESPONSIBLEUSE.md. Xiaomi's chat template already supports both. Do not swap…

Access requested at publisher mit 119B parameters vllm

Model · Text generation

Qwen3.5-397B-A17B-VQ-2.4bpw

Noah Zelezny

95.7 GiB text weights — the daily driver, runs on a single 128 GB Mac. Also ships the bf16 vision tower (+0.85 GiB) and an optional MTP draft head (+5.4 GiB); full download 101.9 GiB. A vector-quantized build of Qwen3.5-397B-A17B that fits and generates on one 128 GB Apple Silicon machine — no cluster, no patches, stock mlx-lm. 12.43% of the 64-element weight groups in the Qwen3.5-397B teacher sit in output rows whose weights are about 1e-29. The vq-skipzero format drops those rows' codes and scales on disk and in memory; they output exact zeros, and the live rows are byte-identical to the previous revision (vqlab sz-check, every module). Text weights go from 107.96 to 95.66 GiB (-12.30…

Open weights apache-2.0 120.2B parameters 262,144 tokens mlx

For more details on how to deploy and use the model - see the Quick Start Guide below! The post-training data has a cutoff date of February 2026. The pre-training data has a cutoff date of June 2025. NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents. Nemotron-3-Super-120B-A12B-BF16 is a large language model (LLM) trained by NVIDIA, designed to deliver strong agentic, reasoning, and conversational capabilities. It is optimized for collaborative agents and high-volume workloads such as IT ticket automation. Like other models in the family, it responds to user queries and…

Open weights other 123.6B parameters 262,144 tokens transformers

Qwen3.8-Flash-Next with 5 routed experts per token instead of 10, healed so it stays close to the original, quantized to int4. It runs on one DGX Spark (GB10, 128 GB) at roughly 64-70 tokens/s. 125B parameters in total, 4.8B active per token. The original activates 6B. Everything needed to serve it is in this one repository, including the 49 GB FP8 n-gram table under ple-table/. Nothing else to download. That builds the serving image, downloads this repository, and starts an OpenAI-compatible server on port 8000. The scripts and the full explanation are in that repo. Serving by hand needs Saren-Arterius/qwen3.8-Flash-DGX-AutoRound, because a stock vLLM cannot serve this checkpoint's int4 +…

Open weights other 124B parameters 262,144 tokens vllm

Model · Text generation

Vinci-Cyber-123B-1.0

SimpleDirect

Vinci Cyber 123B 1.0 is an open-weight model for defensive infrastructure review and targeted remediation, fine-tuned in Canada from Mistral AI's Devstral 2 123B. The released merged weights have now been tested directly, alongside their parent and the available GGUF formats. Focused repairs. Restraint on correct configuration. Weights you can run yourself. On the V2-B neutral-review test, the released BF16 model preserved 24/24 correct configurations and produced 18/24 scanner-credited repairs, all 18 passing offline provider-schema validation. Its parent repaired 17/24 and preserved 0/24. On the second set, V2-A, Cyber again preserved 24/24, but repaired 9/24 versus the parent's 15/24.…

Open weights other 125B parameters 262,144 tokens transformers