Skip to page content
SAVRN
Search Plan a project

Open-weight model · Image and text to text

Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF

by Taurus taurusduan/Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF

Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF is an open-weight model for image and text to text from Taurus, released under MIT License. Its published files total 444.2 GB.

This is an uncensored version of deepseek-ai/DeepSeek-V4-Flash-Vision-Exp created with abliteration (see remove-refusals-with-transformers to know more about it).

Parameters—
Context—
Weights444.2 GB
Licensemit
AccessOpen weights
Monthly Downloads—

Model Card

By Taurus, published under mit, revision 9930104ea6f1.

This is an uncensored version of deepseek-ai/DeepSeek-V4-Flash-Vision-Exp created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. Layers 11-28 are being ablated (1-based indexing) and all expert modules were not ablated. Use the latest llama.cpp, - Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs. - Support our work on Ko-fi!

Read Taurus's full model card

huihui-ai/Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF

This is an uncensored version of deepseek-ai/DeepSeek-V4-Flash-Vision-Exp created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

Note

Layers 11-28 are being ablated (1-based indexing) and all expert modules were not ablated.

llama.cpp

Use the latest llama.cpp,

llama-cli -m huihui-ai/Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-Q4_K.gguf -c 262144

Usage Warnings

  • Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.

  • Not Suitable for All Audiences: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.

  • Legal and Ethical Responsibilities: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.

  • Research and Experimental Use: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.

  • Monitoring and Review Recommendations: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.

  • No Default Safety Guarantees: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.

Donation

Your donation helps us continue our further development and improvement, a cup of coffee can do it.
  • bitcoin:
  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge
  • Support our work on Ko-fi!

Identity and Version

Repository
taurusduan/Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF
Publisher
Taurus
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
9930104ea6f1b471b45c5218b7947bb6669b0ec4
First published
2026-09-30
Last updated
2026-09-30

Files and Weights

6 files, 444.2 GB in total. The weights are 4 files totalling 444.2 GB in gguf.

Weights4 files · 444.2 GB
Documentation1 file · 2.5 KB
Repository1 file · 1.9 KB
Every file
FileTypeSizeSHA-256
Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-Q3_K.ggufWeights135.3 GB 36e0a86b912a
Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-Q4_K.ggufWeights151.5 GB 2e4e772da104
Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-bf16.ggufWeights156.4 GB 00ef3634e9c4
mmproj-model-bf16.ggufWeights934.5 MB 9034f55cadd0
README.mdDocumentation2.5 KB —
.gitattributesRepository1.9 KB —

License and Download

License
mit
Access
Open weights, no gate
Download size
444.2 GB
Download from Taurus

Released by Taurus through its official repository on Hugging Face. Read the license.

Built From

  • Derived from deepseek-ai/DeepSeek-V4-Flash-Vision-Exp
  • Quantized from deepseek-ai/DeepSeek-V4-Flash-Vision-Exp

Memory Requirements

PrecisionWeights in memory
As published444.2 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF

Can I use Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF commercially?

Yes. Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

Similar Models

Non-uniform GGUF quantizations of a 512-expert MoE, produced with GSQ and RCO, with a vision projector for multimodal use. This repository provides GGUF quantizations of Qwen3.8-Flash-Next at four sizes, together with the model's vision projector (mmproj) for multimodal use. In contrast to uniform quantization, which applies a single quantization type to all weight tensors, each model here assigns a separate quantization type to every tensor. The assignment is obtained by a gradient-based search that allocates precision according to per-tensor sensitivity, subject to a total size budget. The resulting files are standard GGUF and run unmodified in llama.cpp, Ollama, and LM Studio. A…

Open weights apache-2.0 gguf
View model

Model · Image and text to text

Huihui-Qwen3.8-27B-abliterated-GGUF

Huihui.ai

This is an uncensored version of Qwen/Qwen3.8-27B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. The newly added Huihui-Qwen3.8-27B-abliterated-Underdog-Saluki series come from ConwayResearch/Underdog-Saluki-27B-1.0 and ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF. Only layers 22 to 52 (0-based indexing) have been ablated, while the other layers remain unablated. It may come with a small disclaimer warning. Due to ConwayResearch/Underdog-Saluki-27B-1.0 not providing an imatrix file, we will attempt to perform ablation by mixing the GGUF…

Open weights apache-2.0 transformers
View model

Model · Image and text to text

Qwen3.8-27B-iMatrix-NVFP4-MTP-GGUF

Michał Piszczek

I built this quant because the ready-made FP4 file answered the wrong question. It was fast, but on my short WikiText-2 control it scored 6.4949 PPL. Plain Q40 scored 6.3798. The first higher-quality hybrid went too far the other way: good perplexity, 34.19 tok/s, and no comfortable room for 256K plus vision. This is the build that survived both gates. It is a 17.1 GB, 5.01 BPW mixed-precision GGUF of Qwen/Qwen3.8-27B. It keeps large, tolerant matrices in native NVFP4 and spends more bits on selected attention, Gated DeltaNet, and late FFN tensors. The trained MTP layer remains embedded in the same GGUF. This is not a fine-tune. I built the private calibration workload from 5,472 messages…

Open weights apache-2.0
View model

Qwen3.8-27B uncensored by HauhauCS 0/465 Refusals. This is the Aggressive variant: direct answers, no refusal behavior, and minimal preamble on hard prompts. Every text GGUF preserves Qwen3.8's native NextN head, and this release adds HauhauCS FastMTP: a specific acceleration sidecar qualified across the complete quant lineup at maximum native context. Vision is included through the separate BF16 projector. No changes to datasets or intended capabilities. This release preserves Qwen3.8-27B's text, reasoning, agentic, image, and video capabilities while applying the HauhauCS Aggressive uncensoring profile. Pick Aggressive when you specifically want the model to get to the answer without…

Open weights apache-2.0
View model

Model · Image and text to text

Qwen3.8-27B-GGUF

GGML Org

Run it in the Llama app: https://llama.app - https://huggingface.co/Qwen/Qwen3.8-27B - https://huggingface.co/incoai/Qwen3.8-27B-DFlash2 - add info

Open weights apache-2.0
View model

lm mmap --lazy-mode on -ngl 99 -c 32768 \ mmproj-Qwen3.8-Flash-Next-BF16.gguf --local-dir. llama-mtmd-cli -m IQ3S/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-IQ3S-00001-of-00002.gguf \ --mmproj mmproj-Qwen3.8-Flash-Next-BF16.gguf -lm mmap --lazy-mode on \ -md mtp-Qwen3.8-Flash-Next-Q80.gguf --draft-max 4 -lm mmap --lazy-mode on -ngl 99 -lm mmap --lazy-mode on keeps the n-gram table memory-mapped on disk: it is 28.8 GB and one row is read per token. Shard 1 wants to be resident (VRAM or RAM); shard 2 is fine on an SSD. The vision projector is a standard clip GGUF shared with the upstream tiers, 0.91 GB. Native context is 262,144 tokens and the KV cache grows with it, so start at -c 32768 and work…

Open weights apache-2.0 gguf
View model