Prism ML's ternary Ternary-Bonsai-2-27B build of Qwen/Qwen3.8-27B, repacked for chad, a Claude-Code-style local coding agent for Apple Silicon, with its speculative decoder bundled in. This is chad's default model. Created using Bonsai by Prism ML. with, already quantized. Nothing is built on first run. Every projection of Qwen3.8-27B (a dense qwen35 hybrid: 64 layers, 48 GatedDeltaNet + 16 full attention) is stored in a Hadamard-rotated basis: multiplied by a fixed sign vector and put through a blockwise Walsh-Hadamard transform offline, then quantized to 2-bit affine group-128 whose three levels reproduce the ternary set {−s, 0, +s}. The rotation costs no extra bits and no extra weight…
Open-weight model · Text generation
WaifuGemma4-26b-a4b-v1
by HiWaifu Research hiwaifu-research/WaifuGemma4-26b-a4b-v1
Gemma 4 26B-A4B, post-trained with GRPO against a reward model learned from 1.2 million double-blind votes cast by HiWaifu users inside their own role-play conversations.
Runs On
What it takes to serve WaifuGemma4-26b-a4b-v1 (25.8B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 51.6 GB | 61.9 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 25.8 GB | 31.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 12.9 GB | 15.5 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.
Model Card
Gemma 4 26B-A4B, post-trained with GRPO against a reward model learned from 1.2 million double-blind votes cast by HiWaifu users inside their own role-play conversations. Put back into the same arena, blind, it met GLM-5.1 in 1,430 battles and won 49.6% of the decided votes; against a 13-model field including Gemini, DeepSeek-v4 and Qwen's character models it won 54.7%. Most open role-play models are tuned on preferences that come from an LLM judge, from a handful of annotators, or from synthetic pairs. We had something rarer: a live arena where, inside ordinary chats on our platform, a user is occasionally shown two candidate replies and asked which one they want to continue with. Those…
Excerpt from the card by HiWaifu Research, licensed gemma.
Configuration
- Architecture
- Gemma4ForConditionalGeneration
- Context length (tokens)
- 262,144
- Layers
- 30
- Hidden size
- 2,816
- Feed-forward size
- 2,112
- Attention heads
- 16
- Key/value heads
- 8
- Head dimension
- 256
- Vocabulary size
- 262,144
- Experts
- 128
- Sliding window (tokens)
- 1,024
- Model type
- gemma4
Identity and Version
- Repository
- hiwaifu-research/WaifuGemma4-26b-a4b-v1
- Publisher
- HiWaifu Research
- Task
- Text generation
- Modality
- Text
- Library
- transformers
- Parameters
- 25.8B parameters
- Languages
- en, es, ru, pt, id, ar, th, fr
- Revision
- 6a2f28dfaf8b83be8e71f6f9723a7067de375fbd
- First published
- 2026-09-18
- Last updated
- 2026-09-18
Files and Weights
30 files, 51.6 GB in total. The weights are 11 files totalling 51.6 GB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model-00001-of-00011.safetensors | Weights | 4.7 GB | f07d72bd6478 |
| model-00002-of-00011.safetensors | Weights | 4.9 GB | cfcc9ac6587a |
| model-00003-of-00011.safetensors | Weights | 4.9 GB | edbc284aad7b |
| model-00004-of-00011.safetensors | Weights | 4.9 GB | 98e837e689d6 |
| model-00005-of-00011.safetensors | Weights | 4.9 GB | 9f1c7f7079c7 |
| model-00006-of-00011.safetensors | Weights | 4.9 GB | 58bedbcb111b |
| model-00007-of-00011.safetensors | Weights | 4.9 GB | 1d02b9a70bc1 |
| model-00008-of-00011.safetensors | Weights | 4.9 GB | f404081024ef |
| model-00009-of-00011.safetensors | Weights | 4.9 GB | c4e07ba9a666 |
| model-00010-of-00011.safetensors | Weights | 4.9 GB | 513279af0dd8 |
| model-00011-of-00011.safetensors | Weights | 2.8 GB | 3b10c4e31ced |
| args.json | Configuration | 26.7 KB | — |
| config.json | Configuration | 3.8 KB | — |
| generation_config.json | Configuration | 204 B | — |
| model.safetensors.index.json | Configuration | 103.2 KB | — |
| processor_config.json | Configuration | 1.7 KB | — |
| README.md | Documentation | 48.9 KB | — |
| assets/arena_depth_language.png | Other | 109.3 KB | 1a47abc14e1b |
| assets/arena_head_to_head.png | Other | 262.1 KB | db6a692955cb |
| assets/arena_length_control.png | Other | 213.1 KB | 3fb1ad355544 |
| assets/arena_lineage.png | Other | 120.7 KB | 58be55032110 |
| assets/arena_reasons.png | Other | 173.1 KB | 272a32906b9b |
| assets/pipeline.png | Other | 135.4 KB | 6ef751884886 |
| assets/rl_training_curves.png | Other | 109.5 KB | 662ec3918fd8 |
| assets/rm_generalization.png | Other | 136.3 KB | bc6c175ee797 |
| assets/rm_training_curves.png | Other | 55.5 KB | — |
| chat_template.jinja | Other | 17.5 KB | — |
| .gitattributes | Repository | 2.1 KB | — |
| tokenizer.json | Tokenizer | 32.2 MB | cc8d3a0ce364 |
| tokenizer_config.json | Tokenizer | 2.7 KB | — |
License and Download
- License
- gemma
- Access
- Open weights, no gate
- Download size
- 51.6 GB
Released by HiWaifu Research through its official repository on Hugging Face.
Built From
- Derived from google/gemma-4-26B-A4B-it
- Described by arXiv:2303.06135
- Described by arXiv:2310.03716
- Described by arXiv:2402.03300
- Described by arXiv:2502.09082
- Described by arXiv:2505.14946
- Described by arXiv:2601.21459
- Described by arXiv:2607.02770
Evaluations
Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.
| Benchmark | Conditions | Result | Reported by | Revision | Date |
|---|---|---|---|---|---|
| ARC | Task text-generationMetric AccComparison conditions not established | 98.39 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
| C-Eval | Task text-generationMetric AccComparison conditions not established | 78.97 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
| C-MMLU | Task text-generationMetric AccComparison conditions not established | 79.56 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
| GSM8K | Task text-generationMetric AccComparison conditions not established | 96.89 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
| HellaSwag | Task text-generationMetric AccComparison conditions not established | 79.78 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
| IFEval | Task text-generationMetric Prompt-level StrictComparison conditions not established | 89.09 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
| MATH-500 | Task text-generationMetric AccComparison conditions not established | 92.8 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
| MMLU | Task text-generationMetric AccComparison conditions not established | 88.59 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
| TruthfulQA | Task text-generationMetric MC AccComparison conditions not established | 75.4 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
| Winogrande | Task text-generationMetric AccComparison conditions not established | 85.4 | hiwaifu-research Publisher reported |
Evaluated revision not stated | — |
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 51.6 GB |
| 16-bit | 51.6 GB |
| 8-bit | 25.8 GB |
| 4-bit | 12.9 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About WaifuGemma4-26b-a4b-v1
How much GPU memory does WaifuGemma4-26b-a4b-v1 need?
About 61.9 GB at 16-bit and 15.5 GB at 4-bit: the weights (25.8B parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run WaifuGemma4-26b-a4b-v1 on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use WaifuGemma4-26b-a4b-v1 commercially?
Yes, with conditions. WaifuGemma4-26b-a4b-v1 is released under Gemma Terms of Use. Gemma models are released under Google's Gemma Terms of Use, which permit commercial use and redistribution subject to the Gemma Prohibited Use Policy, whose restrictions must be passed on to anyone the model is distributed to.
What is WaifuGemma4-26b-a4b-v1's context length?
262,144 tokens, from the maximum position embeddings in its published configuration.
Similar Models
Benefits high quality CPU inference TQ2 on Llama.cpp and Ollama via QAT - Robotcs, Routing, Coding, Multimedia, Advanced tool calling via JiRackDeltaNetTokenizer - JiRack DeltaNet understand video and images that best for Robotics also A fast and efficient 27B model optimized for CPU inference. Built on a Qwen3.8-style DeltaNet architecture (hybrid attention + SSM), with an updated tokenizer that includes Routing, Media, Vision, Sound, Tool call, and Robotics tags. Ready-to-run GGUF quantizations, and native Ollama support with reasoning disabled by default for fast, direct responses. - JiRack is a cloud-ready model that helps save money on cloud infrastructure. It can be used as an expert…
Full 27B-class reasoning in ternary transformer weights — on everyday laptops - \~7.2 GB deployed footprint (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 95% of FP16 intelligence retained: 80.49 average across 15 thinking-mode benchmarks — a higher score than the conventional IQ2XXS build (72.73) at less than two-thirds of its footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within two points of full precision (93.40), coding at 85.96, agentic tool use at 74.01 - End-to-end ternary language weights across embeddings, attention projections, MLP…
V3 applies iterative refinement on top of V2's complementary blend, with targeted corpus expansion. The result: genuine liberation — not just removal of hard refusals but elimination of safety-lecture deflections. - Genuinely answers restricted queries — provides real substance instead of safety lectures - 20/20 on code generation tasks — functional implementations, not disclaimers - Thinking ON compatible — no refusals in either thinking mode - Honest scoring — every response manually audited for real substance, not just absence of "I cannot" - -2.1pp MMLU — modest capability cost for genuine liberation If you're using this model in an agent harness (coding agent, pentest framework, etc.)…
A refusal-removed (abliterated) build of Qwen's Qwen3.8-Flash-Next, quantized to EXL3 2.50 bpw so the full model runs on a single 24 GB card (RTX 3090 / 4090) using MoE CPU-offload — with the vision tower, MTP head, native 262,144-token context, and the PLE n-gram table all intact. Requires the same MoE CPU-offload setup as the stock 2.50bpw pack. Needs ~59 GB host RAM for the CPU expert tail and a fast NVMe for the streamed n-gram table. Expected on an RTX 3090: ~38 tok/s decode with MTP on (~28 without), ~20 tok/s at 175K depth, ~664 tok/s prefill. See the upstream repo for the full measured ledger; this quant uses the identical flags and layout, so numbers should track closely. Fired on…
Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features: - Uniquely support of seamless switching between thinking mode (for complex logical reasoning, math, and coding) and non-thinking mode (for efficient, general-purpose dialogue) within single model, ensuring optimal performance across various scenarios. - Significantly enhancement in its reasoning capabilities, surpassing previous QwQ (in thinking mode) and…