Skip to page content
SAVRN
Search Plan a project

Open-weight model · Image and text to text

Huihui-GLM-5.3-Flash-abliterated-FP4-Local

by Edp1096 edp1096/Huihui-GLM-5.3-Flash-abliterated-FP4-Local

Huihui-GLM-5.3-Flash-abliterated-FP4-Local is an open-weight model for image and text to text from Edp1096, released under other. It has 175.2B parameters and a 1,048,576-token context. At 16-bit it needs about 420.6 GB of GPU memory, which fits on 2x MI325X from $4.00 an hour; at 4-bit, 105.1 GB on 1x MI300X from $1.85, at the lowest prices in the SAVRN Index.

Unofficial NVIDIA FP4-Local derivative with Huihui Q8 deltas applied. Applied delta: DQ(Huihui Q8) - DQ(Unsloth Q8). The conversion used these exact revisions.

Parameters175.2B
Context1,048,576
Weights177.5 GB
Licenseother
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve Huihui-GLM-5.3-Flash-abliterated-FP4-Local (175.2B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 350.5 GB 420.6 GB 2x MI325X (256 GB)
Vultr
$4.00 2x MI355X $5.18 · 3x MI300X $5.55
8-bit 175.2 GB 210.3 GB 1x MI325X (256 GB)
Vultr
$2.00 1x MI355X $2.59 · 2x MI300X $3.70
4-bit 87.6 GB 105.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x MI325X $2.00 · 1x MI355X $2.59

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

Huihui-GLM-5.3-Flash-abliterated-FP4-Local on every accelerator the SAVRN Index prices, at every precision

Model Card

Unofficial NVIDIA FP4-Local derivative with Huihui Q8 deltas applied. Applied delta: DQ(Huihui Q8) - DQ(Unsloth Q8). The conversion used these exact revisions. - Updated 44 attention-output/shared-expert-down matrices in layers 15–36 and 22 scale tensors - Preserved all other tensors, including routed experts, CSF scales, MTP, vision, and tokenizer files - Requantized in the existing FP8 formats; no additional QAD training or activation calibration Requires two DGX Sparks (TP2) and B12X vLLM with CSF support. See runtime-configuration.json for exact tested settings. Cold-start loading caused memory pressure and some host swapping. - All 42 weight files verified; 8/8 smoke checks passed…

Excerpt from the card by Edp1096, licensed other.

Configuration

Architecture
Glm5NextForConditionalGeneration
Context length (tokens)
1,048,576
Layers
45
Hidden size
4,096
Feed-forward size
12,288
Attention heads
64
Key/value heads
64
Head dimension
0
Vocabulary size
154,880
Routed experts
288
Experts active per token
8
Model type
glm5_next
Quantization
modelopt

Identity and Version

Repository
edp1096/Huihui-GLM-5.3-Flash-abliterated-FP4-Local
Publisher
Edp1096
Task
Image and text to text
Modality
Image and text
Library
Model Optimizer
Parameters
175.2B parameters
Languages
Not stated by the source
Revision
feb1505124fe89439565dc0c07d6462b99f1dad1
First published
2026-10-18
Last updated
2026-10-18

Files and Weights

62 files, 177.5 GB in total. The weights are 42 files totalling 177.5 GB in safetensors.

Weights42 files · 177.5 GB
Configuration12 files · 36.2 MB
Tokenizer2 files · 20.2 MB
Documentation2 files · 33.2 KB
Other3 files · 382.3 KB
Repository1 file · 166 B
Every file
FileTypeSizeSHA-256
model-00001-of-00040.safetensorsWeights4.3 GB 6d2fcce2097a
model-00002-of-00040.safetensorsWeights398.3 MB abe5800514c8
model-00003-of-00040.safetensorsWeights4.2 GB 8ab74444e293
model-00004-of-00040.safetensorsWeights4.1 GB 7906492e5293
model-00005-of-00040.safetensorsWeights1.2 GB fa93cdc2b831
model-00006-of-00040.safetensorsWeights3.4 GB 7f36a0aebce9
model-00007-of-00040.safetensorsWeights3.4 GB 08cf34e007f0
model-00008-of-00040.safetensorsWeights3.4 GB 27665caafba3
model-00009-of-00040.safetensorsWeights3.4 GB 6fefef9818a8
model-00010-of-00040.safetensorsWeights3.4 GB 618704500d94
model-00011-of-00040.safetensorsWeights3.4 GB e79fd0c2161f
model-00012-of-00040.safetensorsWeights3.4 GB cc3ce32db330
model-00013-of-00040.safetensorsWeights3.4 GB e44d1253f3fa
model-00014-of-00040.safetensorsWeights3.4 GB b9242f5c3254
model-00015-of-00040.safetensorsWeights5.1 GB 856b041abe13
model-00016-of-00040.safetensorsWeights5.1 GB 4cc6b1eca1fd
model-00017-of-00040.safetensorsWeights5.1 GB 2dc2ef526ecc
model-00018-of-00040.safetensorsWeights5.1 GB e1fa1a86341b
model-00019-of-00040.safetensorsWeights5.1 GB 49ed0fd14fee
model-00020-of-00040.safetensorsWeights5.1 GB 36d13ead5eff
model-00021-of-00040.safetensorsWeights5.1 GB be455e23d817
model-00022-of-00040.safetensorsWeights5.1 GB 7f7a0f6aeea5
model-00023-of-00040.safetensorsWeights5.1 GB 18d7db72e373
model-00024-of-00040.safetensorsWeights5.1 GB 937b03319656
model-00025-of-00040.safetensorsWeights5.1 GB 522b327ece80
model-00026-of-00040.safetensorsWeights5.1 GB fa5956b9758a
model-00027-of-00040.safetensorsWeights5.1 GB 3e2b7685470b
model-00028-of-00040.safetensorsWeights5.1 GB 83df1ae7d43e
model-00029-of-00040.safetensorsWeights5.1 GB 223f763f1a15
model-00030-of-00040.safetensorsWeights5.1 GB 36e81695f6dd
model-00031-of-00040.safetensorsWeights5.1 GB 697493ca2ce3
model-00032-of-00040.safetensorsWeights5.1 GB 1967e72e60ed
model-00033-of-00040.safetensorsWeights5.1 GB 3896f4b76390
model-00034-of-00040.safetensorsWeights5.1 GB 50d2cd8d608d
model-00035-of-00040.safetensorsWeights5.1 GB 27ba1ee0f211
model-00036-of-00040.safetensorsWeights5.1 GB b6954778ce40
model-00037-of-00040.safetensorsWeights5.1 GB 2a956ea3bd94
model-00038-of-00040.safetensorsWeights5.1 GB c12da94d3c16
model-00039-of-00040.safetensorsWeights5.1 GB 5262d01f162e
model-00040-of-00040.safetensorsWeights5.1 GB 73342fa305b4
model-inputscales.safetensorsWeights4.7 MB d3dd6c79b081
tensors/native-QB.safetensorsWeights753.7 MB 3911ecc99b3a
config.jsonConfiguration83.9 KB —
generation_config.jsonConfiguration194 B —
gguf-audit.jsonConfiguration704.2 KB —
hf_quant_config.jsonConfiguration72.0 KB —
model.safetensors.index.jsonConfiguration35.3 MB 1981941b2fab
processor_config.jsonConfiguration909 B —
runtime-configuration.jsonConfiguration2.8 KB —
runtime-healthy-after-tests.jsonConfiguration1.1 KB —
runtime-protocol.jsonConfiguration1.1 KB —
runtime-qualification.jsonConfiguration5.8 KB —
runtime-report.jsonConfiguration14.8 KB —
transfer-manifest.jsonConfiguration73.3 KB —
README.mdDocumentation2.3 KB —
README.nvidia.mdDocumentation30.8 KB —
chat_template.jinjaOther10.9 KB —
qualification-inputs/long-65536.txtOther370.1 KB —
qualification-inputs/vision-fixture.pngOther1.3 KB —
.gitattributesRepository166 B —
tokenizer.jsonTokenizer20.2 MB 19e773648cb4
tokenizer_config.jsonTokenizer761 B —

License and Download

License
other
Access
Open weights, no gate
Download size
177.5 GB
Download from Edp1096

Released by Edp1096 through its official repository on Hugging Face.

Built From

  • Derived from huihui-ai/Huihui-GLM-5.3-Flash-abliterated-GGUF

Memory Requirements

PrecisionWeights in memory
As published177.5 GB
16-bit350.5 GB
8-bit175.2 GB
4-bit87.6 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Huihui-GLM-5.3-Flash-abliterated-FP4-Local

How much GPU memory does Huihui-GLM-5.3-Flash-abliterated-FP4-Local need?

About 420.6 GB at 16-bit and 105.1 GB at 4-bit: the weights (175.2B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Huihui-GLM-5.3-Flash-abliterated-FP4-Local on?

At 16-bit, 2x MI325X from $4.00 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Huihui-GLM-5.3-Flash-abliterated-FP4-Local released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Huihui-GLM-5.3-Flash-abliterated-FP4-Local's context length?

1,048,576 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

Qwen3.8-Flash-Next

Qwen

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other 180B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.8-Flash-Next-Uncensored-NVFP4

OrcaRouter

This model has had its safety alignment substantially removed via abliteration (orthogonalizing the refusal direction out of the residual stream). It will comply with harmful, unethical, or illegal requests the original Qwen3.8-Flash-Next would refuse. Released strictly for legitimate research — interpretability, AI-safety / refusal-mechanism study, red-teaming, and robustness evaluation. You assume full responsibility for how you use it and everything it generates; add your own safety and moderation layers before any deployment. Use must comply with the Apache 2.0 License inherited from the base model and all applicable law. The authors accept no liability for misuse. - A Blackwell GPU…

Access requested at publisher apache-2.0 180B parameters transformers

Model · Image and text to text

Darwin-180B-RSI

FINAL_Bench

flagship of the Darwin family — #1 on AIME 2026, HMMT Feb 2026, GPQA Diamond, MMLU-Pro, MMMU-Pro, LEXam and LEXam-hard, and a model that gets better by learning from its own verified work. Scores as listed on the Hugging Face official benchmark leaderboards (self-reported by each model's publisher). = #1 on that leaderboard. "—" = not reported. Darwin is VIDRAFT's measurement-driven reasoning model family — 50+ official models, 400+ community derivatives, and now two places in the GPQA Diamond top 3 (Darwin-180B-RSI #1 · Darwin-397B-ZTC #3). Darwin treats a strong open model as a parent. It measures where the parent is weak, and strengthens exactly those parts — instead of re-training…

Open weights other 180B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.8-Flash-Next-MLX-oQ3-MTP

Robot Haus

A sensitivity-guided, mixed-precision MLX conversion of Qwen/Qwen3.8-Flash-Next, rebuilt directly from the official BF16 checkpoint with the model's matching native MTP block preserved. oQ3 uses a 3-bit affine base and spends additional precision on sensitive modules. Layer sensitivity was measured with a validated quantized calibration proxy, while every released weight was quantized from the official BF16 checkpoint. The result is a compact model with 746 higher-precision module overrides rather than a uniform 3-bit layout. The upstream tokenizer, current chat template, vision processor, generation configuration, licence, and native MTP configuration are retained. In a compatible oMLX…

Open weights other 180B parameters 262,144 tokens mlx

Model · Image and text to text

Qwen3.8-Flash-Next

Tai Hua

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other 180B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3.8-Flash-Next

Ahmed

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other 180B parameters 262,144 tokens transformers