gemma-4-E4B-it-heretic-QAT-GGUF is an open-weight model from 55, released under Apache License 2.0. Its published files total 5.2 GB.
m gemma-4-E4B-it-heretic-QAT-UD-Q4KXL.gguf \ --jinja -ngl 99 -c 4096 \ --port 8001
Model Card
By 55, published under apache-2.0, revision 5b3ddc78cce4.
m gemma-4-E4B-it-heretic-QAT-UD-Q4KXL.gguf \ --jinja -ngl 99 -c 4096 \ --port 8001
Read 55's full model card
Uncensored version of Google Gemma 4 E4B IT (QAT), processed with Heretic ARA abliteration. Quantized to Q4_0 — only 4 GB, perfect for mobile and edge devices.
Base: coder3101/heretic-QAT · Heretic v1.2.0 · ARA + Row-Norm
| Parameter | Value |
|---|---|
| start_layer_index | 20 |
| end_layer_index | 36 |
| preserve_good_behavior_weight | 0.5805 |
| steer_bad_behavior_weight | 0.0023 |
| overcorrect_relative_weight | 0.7764 |
| neighbor_count | 13 |
| Metric | Heretic | Original QAT |
|---|---|---|
| KL Divergence | 0.0065 | 0 (by definition) |
| Refusals | 5/100 | 98/100 |
| Base Model | google/gemma-4-E4B-it |
| Parameters | 4.5B effective (8B with PLE embeddings) |
| Architecture | Dense with Per-Layer Embeddings (PLE) + multimodal |
| Layers | 42 |
| Hidden Size | 2,560 |
| Context Length | 128K tokens |
| Vocabulary | 262K, 140+ languages |
| Modalities | Text + Image + Audio + Video |
| Quantization | Q4_0 (matching Unsloth UD-Q4_K_XL layout), b9553 llama-quantize |
| Format | Q4_0 (QAT weights optimized for this precision) |
| File Size | 4 GB |
| Effective BPW | 4.54 (all weights Q4_0, norms F32) |
| Tool | llama-quantize (b9553, CUDA 13.3) |
| QAT Advantage | Q4_0 + QAT weights achieves 98.5% Top-1 vs 90.9% naive Q4_0 (+7.6%) |
| General | temp=1.0, top_p=0.95, top_k=64 |
| Coding | temp=0.6, top_p=0.95, top_k=64 |
Use --jinja flag with llama.cpp. Disable thinking: --chat-template-kwargs '{"enable_thinking":false}'.
Only 4 GB — runs on any modern phone with 6GB+ RAM. Compatible with llama.cpp, LM Studio, Jan, MLC LLM, and mobile GGUF runtimes.
llama-server \ -m gemma-4-E4B-it-heretic-QAT-UD-Q4_K_XL.gguf \ --jinja -ngl 99 -c 4096 \ --port 8001
Heretic Abliteration: coder3101 · Heretic v1.2.0 ARA + Row-Norm
QAT Weights: Google Gemma 4 E4B IT
Quantization Recipe: Unsloth UD-Q4_K_XL (Q4_0 layout)
Quantization Tool: llama.cpp b9553 · GitHub
Original Model: Google Gemma 4 E4B IT
Identity and Version
- Repository
- HTNZ555/gemma-4-E4B-it-heretic-QAT-GGUF
- Publisher
- 55
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- en, zh
- Revision
- 5b3ddc78cce49de4ad31e827b851797eb2498ad9
- First published
- 2026-09-27
- Last updated
- 2026-09-27
Files and Weights
5 files, 5.2 GB in total. The weights are 2 files totalling 5.2 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| gemma-4-E4B-it-heretic-QAT-UD-Q4_K_XL.gguf | Weights | 4.3 GB | 063b60c663f5 |
| mmproj-gemma-4-E4B-it-heretic-BF16.gguf | Weights | 991.6 MB | 7c9bafa27f82 |
| README.md | Documentation | 16.4 KB | — |
| README_zh.md | Documentation | 16.3 KB | — |
| .gitattributes | Repository | 1.7 KB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 5.2 GB
Released by 55 through its official repository on Hugging Face. Read the license.
Built From
- Derived from coder3101/gemma-4-E4B-it-qat-q4_0-unquantized-heretic
- Quantized from coder3101/gemma-4-E4B-it-qat-q4_0-unquantized-heretic
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 5.2 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About gemma-4-E4B-it-heretic-QAT-GGUF
Can I use gemma-4-E4B-it-heretic-QAT-GGUF commercially?
Yes. gemma-4-E4B-it-heretic-QAT-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.