Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

CyberStag-Security-26B-A4B-V1-Uncensored-Heretic-i1-GGUF

by Team Mradermacher mradermacher/CyberStag-Security-26B-A4B-V1-Uncensored-Heretic-i1-GGUF

CyberStag-Security-26B-A4B-V1-Uncensored-Heretic-i1-GGUF is an open-weight model for text generation from Team Mradermacher, released under Apache License 2.0. Its published files total 272.7 GB.

weighted/imatrix quants of https://huggingface.co/OS-Software/CyberStag-Security-26B-A4B-V1-Uncensored-Heretic For a convenient overview and download list, visit our model page for this model.

Parameters—
Context—
Weights272.7 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By Team Mradermacher, published under apache-2.0, revision b2555004171e.

weighted/imatrix quants of https://huggingface.co/OS-Software/CyberStag-Security-26B-A4B-V1-Uncensored-Heretic For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/CyberStag-Security-26B-A4B-V1-Uncensored-Heretic-GGUF If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the matter…

Read Team Mradermacher's full model card

About

weighted/imatrix quants of https://huggingface.co/OS-Software/CyberStag-Security-26B-A4B-V1-Uncensored-Heretic

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/CyberStag-Security-26B-A4B-V1-Uncensored-Heretic-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Link Type Size/GB Notes
GGUF imatrix 0.2 imatrix file (for creating your own quants)
GGUF i1-IQ1_M 8.8 mostly desperate
GGUF i1-IQ2_XXS 9.4
GGUF i1-IQ2_XS 9.9
GGUF i1-IQ2_S 10.0
GGUF i1-IQ2_M 10.5
GGUF i1-Q2_K 10.7 IQ3_XXS probably better
GGUF i1-Q2_K_S 10.7 very low quality
GGUF i1-IQ3_XXS 11.4 lower quality
GGUF i1-Q3_K_S 12.3 IQ3_XS probably better
GGUF i1-IQ3_M 12.5
GGUF i1-Q3_K_M 13.4 IQ3_S probably better
GGUF i1-Q3_K_L 13.9 IQ3_M probably better
GGUF i1-IQ4_XS 14.0
GGUF i1-Q4_K_S 15.6 optimal size/speed/quality
GGUF i1-Q4_K_M 16.9 fast, recommended
GGUF i1-Q5_K_S 18.1
GGUF i1-Q6_K 22.7 practically like static Q6_K

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

Identity and Version

Repository
mradermacher/CyberStag-Security-26B-A4B-V1-Uncensored-Heretic-i1-GGUF
Publisher
Team Mradermacher
Task
Text generation
Modality
Text
Library
transformers
Parameters
Not stated by the source
Languages
en, ja
Revision
b2555004171ef8e479d139ad53d016de7b478107
First published
2026-09-25
Last updated
2026-09-25

Files and Weights

24 files, 272.7 GB in total. The weights are 22 files totalling 272.7 GB in gguf.

Weights22 files · 272.7 GB
Documentation1 file · 6.4 KB
Repository1 file · 3.7 KB
Every file
FileTypeSizeSHA-256
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ1_M.ggufWeights8.7 GB e0bfa0abcf4f
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ1_S.ggufWeights8.3 GB 438dd58a4ee1
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ2_M.ggufWeights10.4 GB 09b63dbb84ba
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ2_S.ggufWeights9.9 GB c3ef9d1eb019
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ2_XS.ggufWeights9.8 GB 073e54da90d9
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ2_XXS.ggufWeights9.3 GB 510ad0f1e792
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ3_M.ggufWeights12.4 GB f5ee0af6fc59
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ3_XS.ggufWeights11.6 GB 6cdf72389094
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ3_XXS.ggufWeights11.3 GB 68f5c3308512
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-IQ4_XS.ggufWeights13.9 GB 0d4aa8d9d4a9
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q2_K.ggufWeights10.6 GB 9ec1c709f3c0
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q2_K_S.ggufWeights10.6 GB fcdc514a84bf
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q3_K_L.ggufWeights13.8 GB b1d6a4218813
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q3_K_M.ggufWeights13.3 GB a46165e7fdc2
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q3_K_S.ggufWeights12.2 GB e80aaa692cec
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q4_0.ggufWeights14.5 GB d2aae8cf50c2
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q4_K_M.ggufWeights16.8 GB 50b551ce4cb9
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q4_K_S.ggufWeights15.5 GB a65870893789
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q5_K_M.ggufWeights19.1 GB 5d7669504281
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q5_K_S.ggufWeights18.0 GB 84bc7b75e3d4
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.i1-Q6_K.ggufWeights22.6 GB 06fcb3e5f4f0
CyberStag-Security-26B-A4B-V1-Uncensored-Heretic.imatrix.ggufWeights56.9 MB a179b30e0a2a
README.mdDocumentation6.4 KB —
.gitattributesRepository3.7 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
272.7 GB
Download from Team Mradermacher

Released by Team Mradermacher through its official repository on Hugging Face. Read the license.

Built From

  • Derived from OS-Software/CyberStag-Security-26B-A4B-V1-Uncensored-Heretic
  • Quantized from OS-Software/CyberStag-Security-26B-A4B-V1-Uncensored-Heretic

Memory Requirements

PrecisionWeights in memory
As published272.7 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About CyberStag-Security-26B-A4B-V1-Uncensored-Heretic-i1-GGUF

Can I use CyberStag-Security-26B-A4B-V1-Uncensored-Heretic-i1-GGUF commercially?

Yes. CyberStag-Security-26B-A4B-V1-Uncensored-Heretic-i1-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp