SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

Opti-27B

by Kaleb Cadenhead kacaforyah/Opti-27B

Qwen3.8-27B, text and vision, in an 11.8 GB model file plus a 0.9 GB vision projector: 4.6x smaller than the 16-bit original, within 0.5% of its perplexity, and the perplexity of the 4-bit standard at 30% fewer bytes. 3.47 bits per parameter.

Parameters
Context
Weights12.8 GB
Licenseother
AccessOpen weights
Monthly Downloads

Model Card

Qwen3.8-27B, text and vision, in an 11.8 GB model file plus a 0.9 GB vision projector: 4.6x smaller than the 16-bit original, within 0.5% of its perplexity, and the perplexity of the 4-bit standard at 30% fewer bytes. 3.47 bits per parameter. Runs on a single 16 GB GPU. Opti 27B is Qwen3.8-27B, 27 billion parameters with vision through a projector file, compressed with Opti, a patent-pending compression method. The 16-bit original is 54.7 GB. This file is 11.8 GB, at 3.47 bits per parameter over the whole file, and on wikitext-2 it lands at 1.005x the original's perplexity. Paired window by window against llama.cpp's Q4KM, the 4-bit standard, it is statistically indistinguishable at 29.5%…

Excerpt from the card by Kaleb Cadenhead, licensed other.

Identity and Version

Repository
kacaforyah/Opti-27B
Publisher
Kaleb Cadenhead
Task
Image and text to text
Modality
Image and text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
55320e6a09449444d033d5ae6f3931e7d18f3424
First published
2026-09-17
Last updated
2026-09-18

Files and Weights

9 files, 12.8 GB in total. The weights are 2 files totalling 12.8 GB in gguf.

Weights2 files · 12.8 GB
Documentation4 files · 20.6 KB
Other2 files · 39.2 KB
Repository1 file · 2.0 KB
Every file
FileTypeSizeSHA-256
Opti-27B-mmproj-f16.ggufWeights927.6 MB 4200f9a0d79e
Opti-27B.ggufWeights11.8 GB bb0a0481a9ba
LICENSEDocumentation3.5 KB
README.mdDocumentation10.6 KB
runtime/LICENSEDocumentation2.9 KB
runtime/README.mdDocumentation3.5 KB
runtime/build.shOther956 B
runtime/opti-runtime.patchOther38.2 KB
.gitattributesRepository2.0 KB

License and Download

License
other
Access
Open weights, no gate
Download size
12.8 GB
Download from Kaleb Cadenhead

Released by Kaleb Cadenhead through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published12.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Opti-27B

What license is Opti-27B released under?

other, as its publisher declares it. Read the license text before commercial use.

Similar Models

Model · Image and text to text

Qwen3.8-27B-iMatrix-NVFP4-MTP-GGUF

Michał Piszczek

I built this quant because the ready-made FP4 file answered the wrong question. It was fast, but on my short WikiText-2 control it scored 6.4949 PPL. Plain Q40 scored 6.3798. The first higher-quality hybrid went too far the other way: good perplexity, 34.19 tok/s, and no comfortable room for 256K plus vision. This is the build that survived both gates. It is a 17.1 GB, 5.01 BPW mixed-precision GGUF of Qwen/Qwen3.8-27B. It keeps large, tolerant matrices in native NVFP4 and spends more bits on selected attention, Gated DeltaNet, and late FFN tensors. The trained MTP layer remains embedded in the same GGUF. This is not a fine-tune. I built the private calibration workload from 5,472 messages…

Open weights apache-2.0

Model · Image and text to text

Huihui-Qwen3.8-27B-abliterated-GGUF

Huihui.ai

This is an uncensored version of Qwen/Qwen3.8-27B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. The newly added Huihui-Qwen3.8-27B-abliterated-GSQ-RCO series come from ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF. Only layers 23 to 51 have been ablated, while the other layers remain unablated. It may come with a small disclaimer warning. The size after conversion may differ from the original GGUF. The newly added Huihui-Qwen3.8-27B-abliterated-UD series come from unsloth/Qwen3.8-27B-GGUF. Only layers 18 to 51 have been ablated(Previously…

Open weights apache-2.0 transformers

Qwen3.8-27B uncensored by HauhauCS 0/465 Refusals. This is the Aggressive variant: direct answers, no refusal behavior, and minimal preamble on hard prompts. Every text GGUF preserves Qwen3.8's native NextN head, and this release adds HauhauCS FastMTP: a specific acceleration sidecar qualified across the complete quant lineup at maximum native context. Vision is included through the separate BF16 projector. No changes to datasets or intended capabilities. This release preserves Qwen3.8-27B's text, reasoning, agentic, image, and video capabilities while applying the HauhauCS Aggressive uncensoring profile. Pick Aggressive when you specifically want the model to get to the answer without…

Open weights apache-2.0

Model · Image and text to text

Gemma-4-E4B-Uncensored-HauhauCS-Aggressive

HauhauCS

Gemma 4 E4B-IT uncensored by HauhauCS. 0/465 Refusals\ No changes to datasets or capabilities. Fully functional, 100% of what the original authors intended - just without the refusals. These are meant to be the best lossless uncensored models out there. Stronger uncensoring — model is fully unlocked and won't refuse prompts. May occasionally append short disclaimers (baked into base model training, not refusals) but full content is always generated. For a more conservative uncensor that keeps some safety guardrails, check the Balanced variant when it's available. All quants generated with importance matrix (imatrix) for optimal quality preservation on abliterated weights. KP ("Perfect")…

Open weights gemma

Model · Image and text to text

Qwen3.5-9B-GGUF

Unsloth AI

You can now also fine-tune the model locally with Unsloth. - Read our Qwen3.5 fine-tuning guide here. Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty…

Open weights apache-2.0 transformers

Model · Image and text to text

Qwen3.8-Flash-Next-GGUF

Unsloth AI

As the frontier of foundation models pushes toward ever-larger parameter counts and ever-longer context windows, the question is no longer just how much we can scale, but how efficiently we can do so. Sustainable progress toward artificial general intelligence (AGI) that benefits everyone demands architectural innovation. Today, we are sharing a concrete step in that direction: Qwen3.8-Flash-Next. This experimental preview of the architecture that will underpin Qwen4 is built around a fundamental rethinking of how the core components of modern large language models (LLMs) interact at scale. The first open-weight release under this architecture is Qwen3.8-Flash-Next, which introduces: For…

Open weights other