SAVRN
Search Contact SAVRN

Open-weight model · Text generation

WaifuGemma4-26b-a4b-v1

by HiWaifu Research hiwaifu-research/WaifuGemma4-26b-a4b-v1

Gemma 4 26B-A4B, post-trained with GRPO against a reward model learned from 1.2 million double-blind votes cast by HiWaifu users inside their own role-play conversations.

Parameters25.8B
Context262,144
Weights51.6 GB
Licensegemma
AccessOpen weights
Monthly Downloads

Runs On

What it takes to serve WaifuGemma4-26b-a4b-v1 (25.8B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 51.6 GB 61.9 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 25.8 GB 31.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 12.9 GB 15.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

Gemma 4 26B-A4B, post-trained with GRPO against a reward model learned from 1.2 million double-blind votes cast by HiWaifu users inside their own role-play conversations. Put back into the same arena, blind, it met GLM-5.1 in 1,430 battles and won 49.6% of the decided votes; against a 13-model field including Gemini, DeepSeek-v4 and Qwen's character models it won 54.7%. Most open role-play models are tuned on preferences that come from an LLM judge, from a handful of annotators, or from synthetic pairs. We had something rarer: a live arena where, inside ordinary chats on our platform, a user is occasionally shown two candidate replies and asked which one they want to continue with. Those…

Excerpt from the card by HiWaifu Research, licensed gemma.

Configuration

Architecture
Gemma4ForConditionalGeneration
Context length (tokens)
262,144
Layers
30
Hidden size
2,816
Feed-forward size
2,112
Attention heads
16
Key/value heads
8
Head dimension
256
Vocabulary size
262,144
Experts
128
Sliding window (tokens)
1,024
Model type
gemma4

Identity and Version

Repository
hiwaifu-research/WaifuGemma4-26b-a4b-v1
Publisher
HiWaifu Research
Task
Text generation
Modality
Text
Library
transformers
Parameters
25.8B parameters
Languages
en, es, ru, pt, id, ar, th, fr
Revision
6a2f28dfaf8b83be8e71f6f9723a7067de375fbd
First published
2026-09-18
Last updated
2026-09-18

Files and Weights

30 files, 51.6 GB in total. The weights are 11 files totalling 51.6 GB in safetensors.

Weights11 files · 51.6 GB
Configuration5 files · 135.6 KB
Tokenizer2 files · 32.2 MB
Documentation1 file · 48.9 KB
Other10 files · 1.3 MB
Repository1 file · 2.1 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00011.safetensorsWeights4.7 GB f07d72bd6478
model-00002-of-00011.safetensorsWeights4.9 GB cfcc9ac6587a
model-00003-of-00011.safetensorsWeights4.9 GB edbc284aad7b
model-00004-of-00011.safetensorsWeights4.9 GB 98e837e689d6
model-00005-of-00011.safetensorsWeights4.9 GB 9f1c7f7079c7
model-00006-of-00011.safetensorsWeights4.9 GB 58bedbcb111b
model-00007-of-00011.safetensorsWeights4.9 GB 1d02b9a70bc1
model-00008-of-00011.safetensorsWeights4.9 GB f404081024ef
model-00009-of-00011.safetensorsWeights4.9 GB c4e07ba9a666
model-00010-of-00011.safetensorsWeights4.9 GB 513279af0dd8
model-00011-of-00011.safetensorsWeights2.8 GB 3b10c4e31ced
args.jsonConfiguration26.7 KB
config.jsonConfiguration3.8 KB
generation_config.jsonConfiguration204 B
model.safetensors.index.jsonConfiguration103.2 KB
processor_config.jsonConfiguration1.7 KB
README.mdDocumentation48.9 KB
assets/arena_depth_language.pngOther109.3 KB 1a47abc14e1b
assets/arena_head_to_head.pngOther262.1 KB db6a692955cb
assets/arena_length_control.pngOther213.1 KB 3fb1ad355544
assets/arena_lineage.pngOther120.7 KB 58be55032110
assets/arena_reasons.pngOther173.1 KB 272a32906b9b
assets/pipeline.pngOther135.4 KB 6ef751884886
assets/rl_training_curves.pngOther109.5 KB 662ec3918fd8
assets/rm_generalization.pngOther136.3 KB bc6c175ee797
assets/rm_training_curves.pngOther55.5 KB
chat_template.jinjaOther17.5 KB
.gitattributesRepository2.1 KB
tokenizer.jsonTokenizer32.2 MB cc8d3a0ce364
tokenizer_config.jsonTokenizer2.7 KB

License and Download

License
gemma
Access
Open weights, no gate
Download size
51.6 GB
Download from HiWaifu Research

Released by HiWaifu Research through its official repository on Hugging Face.

Built From

  • Derived from google/gemma-4-26B-A4B-it
  • Described by arXiv:2303.06135
  • Described by arXiv:2310.03716
  • Described by arXiv:2402.03300
  • Described by arXiv:2502.09082
  • Described by arXiv:2505.14946
  • Described by arXiv:2601.21459
  • Described by arXiv:2607.02770

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
ARC Task text-generationMetric AccComparison conditions not established 98.39 hiwaifu-research
Publisher reported
Evaluated revision not stated
C-Eval Task text-generationMetric AccComparison conditions not established 78.97 hiwaifu-research
Publisher reported
Evaluated revision not stated
C-MMLU Task text-generationMetric AccComparison conditions not established 79.56 hiwaifu-research
Publisher reported
Evaluated revision not stated
GSM8K Task text-generationMetric AccComparison conditions not established 96.89 hiwaifu-research
Publisher reported
Evaluated revision not stated
HellaSwag Task text-generationMetric AccComparison conditions not established 79.78 hiwaifu-research
Publisher reported
Evaluated revision not stated
IFEval Task text-generationMetric Prompt-level StrictComparison conditions not established 89.09 hiwaifu-research
Publisher reported
Evaluated revision not stated
MATH-500 Task text-generationMetric AccComparison conditions not established 92.8 hiwaifu-research
Publisher reported
Evaluated revision not stated
MMLU Task text-generationMetric AccComparison conditions not established 88.59 hiwaifu-research
Publisher reported
Evaluated revision not stated
TruthfulQA Task text-generationMetric MC AccComparison conditions not established 75.4 hiwaifu-research
Publisher reported
Evaluated revision not stated
Winogrande Task text-generationMetric AccComparison conditions not established 85.4 hiwaifu-research
Publisher reported
Evaluated revision not stated

Memory Requirements

PrecisionWeights in memory
As published51.6 GB
16-bit51.6 GB
8-bit25.8 GB
4-bit12.9 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About WaifuGemma4-26b-a4b-v1

How much GPU memory does WaifuGemma4-26b-a4b-v1 need?

About 61.9 GB at 16-bit and 15.5 GB at 4-bit: the weights (25.8B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run WaifuGemma4-26b-a4b-v1 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use WaifuGemma4-26b-a4b-v1 commercially?

Yes, with conditions. WaifuGemma4-26b-a4b-v1 is released under Gemma Terms of Use. Gemma models are released under Google's Gemma Terms of Use, which permit commercial use and redistribution subject to the Gemma Prohibited Use Policy, whose restrictions must be passed on to anyone the model is distributed to.

What is WaifuGemma4-26b-a4b-v1's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Prism ML's ternary Ternary-Bonsai-2-27B build of Qwen/Qwen3.8-27B, repacked for chad, a Claude-Code-style local coding agent for Apple Silicon, with its speculative decoder bundled in. This is chad's default model. Created using Bonsai by Prism ML. with, already quantized. Nothing is built on first run. Every projection of Qwen3.8-27B (a dense qwen35 hybrid: 64 layers, 48 GatedDeltaNet + 16 full attention) is stored in a Hadamard-rotated basis: multiplied by a fixed sign vector and put through a blockwise Walsh-Hadamard transform offline, then quantized to 2-bit affine group-128 whose three levels reproduce the ternary set {−s, 0, +s}. The rotation costs no extra bits and no extra weight…

Open weights apache-2.0 26.9B parameters 262,144 tokens mlx

Benefits high quality CPU inference TQ2 on Llama.cpp and Ollama via QAT - Robotcs, Routing, Coding, Multimedia, Advanced tool calling via JiRackDeltaNetTokenizer - JiRack DeltaNet understand video and images that best for Robotics also A fast and efficient 27B model optimized for CPU inference. Built on a Qwen3.8-style DeltaNet architecture (hybrid attention + SSM), with an updated tokenizer that includes Routing, Media, Vision, Sound, Tool call, and Robotics tags. Ready-to-run GGUF quantizations, and native Ollama support with reasoning disabled by default for fast, direct responses. - JiRack is a cloud-ready model that helps save money on cloud infrastructure. It can be used as an expert…

Open weights mit 27.3B parameters 262,144 tokens

Model · Text generation

Ternary-Bonsai-27B-mlx-2bit

Prism ML

Full 27B-class reasoning in ternary transformer weights — on everyday laptops - \~7.2 GB deployed footprint (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 95% of FP16 intelligence retained: 80.49 average across 15 thinking-mode benchmarks — a higher score than the conventional IQ2XXS build (72.73) at less than two-thirds of its footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within two points of full precision (93.40), coding at 85.96, agentic tool use at 74.01 - End-to-end ternary language weights across embeddings, attention projections, MLP…

Open weights apache-2.0 27.4B parameters 262,144 tokens mlx

Model · Text generation

Qwen3.8-27B-OBLITERATED

OBLITERATUS

V3 applies iterative refinement on top of V2's complementary blend, with targeted corpus expansion. The result: genuine liberation — not just removal of hard refusals but elimination of safety-lecture deflections. - Genuinely answers restricted queries — provides real substance instead of safety lectures - 20/20 on code generation tasks — functional implementations, not disclaimers - Thinking ON compatible — no refusals in either thinking mode - Honest scoring — every response manually audited for real substance, not just absence of "I cannot" - -2.1pp MMLU — modest capability cost for genuine liberation If you're using this model in an agent harness (coding agent, pentest framework, etc.)…

Open weights apache-2.0 27.8B parameters 262,144 tokens mlx

A refusal-removed (abliterated) build of Qwen's Qwen3.8-Flash-Next, quantized to EXL3 2.50 bpw so the full model runs on a single 24 GB card (RTX 3090 / 4090) using MoE CPU-offload — with the vision tower, MTP head, native 262,144-token context, and the PLE n-gram table all intact. Requires the same MoE CPU-offload setup as the stock 2.50bpw pack. Needs ~59 GB host RAM for the CPU expert tail and a fast NVMe for the streamed n-gram table. Expected on an RTX 3090: ~38 tok/s decode with MTP on (~28 without), ~20 tok/s at 175K depth, ~664 tok/s prefill. See the upstream repo for the full measured ledger; this quant uses the identical flags and layout, so numbers should track closely. Fired on…

Open weights other 22.3B parameters 262,144 tokens

Model · Text generation

Qwen3-30B-A3B

Qwen

Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features: - Uniquely support of seamless switching between thinking mode (for complex logical reasoning, math, and coding) and non-thinking mode (for efficient, general-purpose dialogue) within single model, ensuring optimal performance across various scenarios. - Significantly enhancement in its reasoning capabilities, surpassing previous QwQ (in thinking mode) and…

Open weights apache-2.0 30.5B parameters 40,960 tokens transformers