Skip to page content
SAVRN
Search Plan a project

Open-weight model · Image and text to text

Huihui-GLM-5.3-Flash-abliterated-GGUF

by Taurus taurusduan/Huihui-GLM-5.3-Flash-abliterated-GGUF

Huihui-GLM-5.3-Flash-abliterated-GGUF is an open-weight model for image and text to text from Taurus, released under MIT License. Its published files total 450.8 GB.

This is an uncensored version of zai-org/GLM-5.3-Flash created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model.

Parameters—
Context—
Weights450.8 GB
Licensemit
AccessOpen weights
Monthly Downloads—

Model Card

By Taurus, published under mit, revision e2b78db8cb2d.

This is an uncensored version of zai-org/GLM-5.3-Flash created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model. GGUFs come from unsloth/GLM-5.3-Flash-GGUF. Only layers 15 to 35 (0-based indexing) have been ablated, while the other layers and all expert modules remain unablated. To run, please unslothai llama.cpp PR, - Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.…

Read Taurus's full model card

huihui-ai/Huihui-GLM-5.3-Flash-abliterated-GGUF

This is an uncensored version of zai-org/GLM-5.3-Flash created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model.

Note

GGUFs come from unsloth/GLM-5.3-Flash-GGUF.

Only layers 15 to 35 (0-based indexing) have been ablated, while the other layers and all expert modules remain unablated.

llama.cpp

To run, please unslothai llama.cpp PR,

llama-cli -m huihui-ai/Huihui-GLM-5.3-Flash-abliterated-GGUF/UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf -c 262144

Usage Warnings

  • Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.

  • Not Suitable for All Audiences: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.

  • Legal and Ethical Responsibilities: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.

  • Research and Experimental Use: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.

  • Monitoring and Review Recommendations: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.

  • No Default Safety Guarantees: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.

Donation

Your donation helps us continue our further development and improvement, a cup of coffee can do it.
  • bitcoin:
  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge
  • Support our work on Ko-fi!

Identity and Version

Repository
taurusduan/Huihui-GLM-5.3-Flash-abliterated-GGUF
Publisher
Taurus
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
Not stated by the source
Languages
en, zh
Revision
e2b78db8cb2d30c65dc7353cb597e96fcc555877
First published
2026-09-30
Last updated
2026-09-30

Files and Weights

17 files, 450.8 GB in total. The weights are 15 files totalling 450.8 GB in gguf.

Weights15 files · 450.8 GB
Documentation1 file · 2.6 KB
Repository1 file · 2.8 KB
Every file
FileTypeSizeSHA-256
UD-IQ1_S/GLM-5.3-Flash-UD-IQ1_S-00001-of-00003.ggufWeights9.4 MB dadc3c2fbb23
UD-IQ1_S/GLM-5.3-Flash-UD-IQ1_S-00002-of-00003.ggufWeights49.6 GB 43da40c25ea0
UD-IQ1_S/GLM-5.3-Flash-UD-IQ1_S-00003-of-00003.ggufWeights43.5 GB 4dd80f68448d
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00001-of-00005.ggufWeights9.4 MB aa55ffca8bde
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00002-of-00005.ggufWeights50.0 GB b2b6d0f519f2
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00003-of-00005.ggufWeights49.6 GB f4eceffc465d
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00004-of-00005.ggufWeights49.5 GB ff6a85441a5e
UD-IQ4_XS/GLM-5.3-Flash-UD-IQ4_XS-00005-of-00005.ggufWeights7.7 GB d7e1e587c756
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.ggufWeights9.4 MB a9a9a0a14a12
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00002-of-00006.ggufWeights49.2 GB 8731c940c7b7
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00003-of-00006.ggufWeights50.0 GB 7ec974014870
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00004-of-00006.ggufWeights48.7 GB 3cf71f88ce28
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00005-of-00006.ggufWeights49.0 GB 9e55e6be21b0
UD-Q4_K_XL/GLM-5.3-Flash-UD-Q4_K_XL-00006-of-00006.ggufWeights2.8 GB cbce8cca7001
mmproj-model-bf16.ggufWeights1.2 GB bb726c59e7cc
README.mdDocumentation2.6 KB —
.gitattributesRepository2.8 KB —

License and Download

License
mit
Access
Open weights, no gate
Download size
450.8 GB
Download from Taurus

Released by Taurus through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published450.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Huihui-GLM-5.3-Flash-abliterated-GGUF

Can I use Huihui-GLM-5.3-Flash-abliterated-GGUF commercially?

Yes. Huihui-GLM-5.3-Flash-abliterated-GGUF is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

Similar Models

Non-uniform GGUF quantizations of a 512-expert MoE, produced with GSQ and RCO, with a vision projector for multimodal use. This repository provides GGUF quantizations of Qwen3.8-Flash-Next at four sizes, together with the model's vision projector (mmproj) for multimodal use. In contrast to uniform quantization, which applies a single quantization type to all weight tensors, each model here assigns a separate quantization type to every tensor. The assignment is obtained by a gradient-based search that allocates precision according to per-tensor sensitivity, subject to a total size budget. The resulting files are standard GGUF and run unmodified in llama.cpp, Ollama, and LM Studio. A…

Open weights apache-2.0 gguf
View model

Model · Image and text to text

Huihui-Qwen3.8-27B-abliterated-GGUF

Huihui.ai

This is an uncensored version of Qwen/Qwen3.8-27B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. The newly added Huihui-Qwen3.8-27B-abliterated-Underdog-Saluki series come from ConwayResearch/Underdog-Saluki-27B-1.0 and ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF. Only layers 22 to 52 (0-based indexing) have been ablated, while the other layers remain unablated. It may come with a small disclaimer warning. Due to ConwayResearch/Underdog-Saluki-27B-1.0 not providing an imatrix file, we will attempt to perform ablation by mixing the GGUF…

Open weights apache-2.0 transformers
View model

Model · Image and text to text

Qwen3.8-27B-iMatrix-NVFP4-MTP-GGUF

Michał Piszczek

I built this quant because the ready-made FP4 file answered the wrong question. It was fast, but on my short WikiText-2 control it scored 6.4949 PPL. Plain Q40 scored 6.3798. The first higher-quality hybrid went too far the other way: good perplexity, 34.19 tok/s, and no comfortable room for 256K plus vision. This is the build that survived both gates. It is a 17.1 GB, 5.01 BPW mixed-precision GGUF of Qwen/Qwen3.8-27B. It keeps large, tolerant matrices in native NVFP4 and spends more bits on selected attention, Gated DeltaNet, and late FFN tensors. The trained MTP layer remains embedded in the same GGUF. This is not a fine-tune. I built the private calibration workload from 5,472 messages…

Open weights apache-2.0
View model

Qwen3.8-27B uncensored by HauhauCS 0/465 Refusals. This is the Aggressive variant: direct answers, no refusal behavior, and minimal preamble on hard prompts. Every text GGUF preserves Qwen3.8's native NextN head, and this release adds HauhauCS FastMTP: a specific acceleration sidecar qualified across the complete quant lineup at maximum native context. Vision is included through the separate BF16 projector. No changes to datasets or intended capabilities. This release preserves Qwen3.8-27B's text, reasoning, agentic, image, and video capabilities while applying the HauhauCS Aggressive uncensoring profile. Pick Aggressive when you specifically want the model to get to the answer without…

Open weights apache-2.0
View model

Model · Image and text to text

Qwen3.8-27B-GGUF

GGML Org

Run it in the Llama app: https://llama.app - https://huggingface.co/Qwen/Qwen3.8-27B - https://huggingface.co/incoai/Qwen3.8-27B-DFlash2 - add info

Open weights apache-2.0
View model

lm mmap --lazy-mode on -ngl 99 -c 32768 \ mmproj-Qwen3.8-Flash-Next-BF16.gguf --local-dir. llama-mtmd-cli -m IQ3S/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-IQ3S-00001-of-00002.gguf \ --mmproj mmproj-Qwen3.8-Flash-Next-BF16.gguf -lm mmap --lazy-mode on \ -md mtp-Qwen3.8-Flash-Next-Q80.gguf --draft-max 4 -lm mmap --lazy-mode on -ngl 99 -lm mmap --lazy-mode on keeps the n-gram table memory-mapped on disk: it is 28.8 GB and one row is read per token. Shard 1 wants to be resident (VRAM or RAM); shard 2 is fine on an SSD. The vision projector is a standard clip GGUF shared with the upstream tiers, 0.91 GB. Native context is 262,144 tokens and the KV cache grows with it, so start at -c 32768 and work…

Open weights apache-2.0 gguf
View model