SAVRN
Search Contact SAVRN

Open-weight model · Text generation

Anansi-35B-A3B-Q8-Prose-GGUF

by Matthew Andrews BlueNipples/Anansi-35B-A3B-Q8-Prose-GGUF

Anansi-35B-A3B-Q8-Prose-GGUF is an open-weight model for text generation from Matthew Andrews, released under Apache License 2.0. Its published files total 33.8 GB.

Anansi-35B-A3B balances good instruct following, narrative reasoning, and sweet prose. Specifically for my 8GB potato, because I can't run the ~30B dense models, but maybe it can be good for your potato too? This is the repo for Q8 prose/style head GGUFs.

Parameters
Context
Weights33.8 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads

Model Card

By Matthew Andrews, published under apache-2.0, revision 2d1889dfc232.

Anansi-35B-A3B balances good instruct following, narrative reasoning, and sweet prose. Specifically for my 8GB potato, because I can't run the ~30B dense models, but maybe it can be good for your potato too? This is the repo for Q8 prose/style head GGUFs. The Q8-Prose versions use the same Anansi LM output head — the DARE/TIES merge head interpolated with Melody — but restored at Q80 fidelity. The idea is to preserve more of the prose/style effect by avoiding some of the precision loss that comes from quantizing the head along with the rest of the model. There are also Q8-DarkScarlett versions using the same interpolated-head approach with ReadyArt's Dark Scarlett instead of Melody, giving…

Read Matthew Andrews's full model card

Anansi-35B-A3B

Anansi-35B-A3B balances good instruct following, narrative reasoning, and sweet prose. Specifically for my 8GB potato, because I can't run the ~30B dense models, but maybe it can be good for your potato too?

This is the repo for Q8 prose/style head GGUFs. The Q8-Prose versions use the same Anansi LM output head — the DARE/TIES merge head interpolated with Melody — but restored at Q8_0 fidelity. The idea is to preserve more of the prose/style effect by avoiding some of the precision loss that comes from quantizing the head along with the rest of the model.

There are also Q8-DarkScarlett versions using the same interpolated-head approach with ReadyArt's Dark Scarlett instead of Melody, giving Anansi an alternate prose/style variant while preserving its underlying reasoning and instruction behaviour. Big thanks to ReadyArt for the donor model.

The Q8-Prose versions are the standard Anansi model with a higher-fidelity prose head. The Dark Scarlett versions are alternate LM-head variants of the same model.

The full Safetensors base model, along with more detail on the merge method and other characteristics, is here.

Recast / additional prose pass

With Anansi in general, and especially with these Q8 prose-head versions if you find the higher-fidelity head gives you a useful prose bump, I recommend at least trying it with the Recast post-processing extension in SillyTavern.

I've found this combination unusually reliable for doing a single additional prose pass. Give the model instructions describing the kind of prose you want (or don't want), tell it to keep its reasoning concise and only output the revision, and keep the original reply reasonably short. I use a fairly high maximum token limit (16k), with my system/character instructions targeting roughly four or five paragraphs.

The model will often still include some reasoning or extra drafts in the result. I just delete those and keep the final revision. It's much easier than editing the prose myself, and in my testing it has been very consistent.

This was actually part of what I was aiming for with Anansi: strong enough instruction following to handle non-continuation tasks like post-processing reliably, while still having the stronger prose and narrative focus I liked in WorldSim. The extra pass can push the prose a fair bit further, although it does mean giving the model enough output space to think and rewrite without getting cut off.

The same general approach may also work with other post-processing workflows or environments that can give the model a revision task rather than asking it to continue the story.

Identity and Version

Repository
BlueNipples/Anansi-35B-A3B-Q8-Prose-GGUF
Publisher
Matthew Andrews
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
2d1889dfc232c15c0a5c1d9a55d835dbff532459
First published
2026-09-22
Last updated
2026-09-22

Files and Weights

4 files, 33.8 GB in total. The weights are 2 files totalling 33.8 GB in gguf.

Weights2 files · 33.8 GB
Documentation1 file · 3.0 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
Anansi-35B-A3B.i1-Q3_K_M-Q8-DarkScarlett.ggufWeights16.9 GB 396e57f05592
Anansi-35B-A3B.i1-Q3_K_M-Q8-Prose.ggufWeights16.9 GB 62a8e14a7c46
README.mdDocumentation3.0 KB
.gitattributesRepository1.7 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
33.8 GB
Download from Matthew Andrews

Released by Matthew Andrews through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published33.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Anansi-35B-A3B-Q8-Prose-GGUF

Can I use Anansi-35B-A3B-Q8-Prose-GGUF commercially?

Yes. Anansi-35B-A3B-Q8-Prose-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Fine-tune Qwen3 (14B) for free using our Google Colab notebook! - Read our Blog about Qwen3 support: unsloth.ai/blog/qwen3 - View the rest of our notebooks in our docs here. Qwen3-Coder is available in multiple sizes. Today, we're excited to introduce Qwen3-Coder-30B-A3B-Instruct. This streamlined model maintains impressive performance and efficiency, featuring the following key enhancements: - Significant Performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks. - Long-context Capabilities with native support for 256K tokens, extendable up to 1M tokens using Yarn, optimized for repository-scale understanding. - Agentic Coding supporting for…

Open weights apache-2.0 transformers

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers