SAVRN
Search Contact SAVRN

Open-weight model · Any to any

gemma-4-26B-A4B-it-assistant

by Google google/gemma-4-26B-A4B-it-assistant

Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output.

Parameters420M
Context262,144
Weights839.4 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads124.9k

Runs On

What it takes to serve gemma-4-26B-A4B-it-assistant (420M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.8 GB 1.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.4 GB 0.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.2 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By Google, published under apache-2.0, revision 6e5aaaf4c42b.

Hugging Face | GitHub | MTP Documentation | Technical Report
License: Apache 2.0 | Authors: Google DeepMind

[!Note] This model card is for the Multi-Token Prediction (MTP) drafters for the Gemma 4 models. MTP is implemented by extending the base model with a smaller, faster draft model. When used in a Speculative Decoding pipeline, the draft model predicts several tokens ahead, which the target model then verifies in parallel. This results in significant decoding speedups (up to 3x) while guaranteeing the exact same quality as standard generation, making these checkpoints perfect for low-latency and on-device applications.

Read the full model card (3,614 words)

Configuration

Architecture
Gemma4AssistantForCausalLM
Context length (tokens)
262,144
Layers
4
Hidden size
1,024
Feed-forward size
8,192
Attention heads
16
Key/value heads
8
Head dimension
256
Vocabulary size
262,144
Sliding window (tokens)
1,024
Model type
gemma4_assistant

Identity and Version

Repository
google/gemma-4-26B-A4B-it-assistant
Publisher
Google
Task
Any to any
Modality
Multimodal
Library
transformers
Parameters
420M parameters
Languages
Not stated by the source
Revision
6e5aaaf4c42b98394530b8fda2e95cadd65c151c
First published
2026-04-23
Last updated
2026-07-15

Files and Weights

7 files, 871.6 MB in total. The weights are 1 file totalling 839.4 MB in safetensors.

Weights1 file · 839.4 MB
Configuration2 files · 2.6 KB
Tokenizer2 files · 32.2 MB
Documentation1 file · 29.8 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights839.4 MB 006c8713b29b
config.jsonConfiguration2.3 KB
generation_config.jsonConfiguration307 B
README.mdDocumentation29.8 KB
.gitattributesRepository1.6 KB
tokenizer.jsonTokenizer32.2 MB 75a6583c1a41
tokenizer_config.jsonTokenizer822 B

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
839.4 MB
Download from Google

Released by Google through Kaggle. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published839.4 MB
16-bit0.8 GB
8-bit0.4 GB
4-bit0.2 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About gemma-4-26B-A4B-it-assistant

How much GPU memory does gemma-4-26B-A4B-it-assistant need?

About 1 GB at 16-bit and 0.3 GB at 4-bit: the weights (420M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run gemma-4-26B-A4B-it-assistant on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use gemma-4-26B-A4B-it-assistant commercially?

Yes. gemma-4-26B-A4B-it-assistant is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is gemma-4-26B-A4B-it-assistant's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Any to any

gemma-4-31B-it-assistant

Google

Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in five distinct sizes: E2B, E4B, 12B, 26B A4B, and 31B. Their diverse sizes make them deployable in environments ranging from…

Open weights apache-2.0 470M parameters 262,144 tokens transformers

Model · Any to any

gemma-4-E4B-it-assistant

Google

Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in five distinct sizes: E2B, E4B, 12B, 26B A4B, and 31B. Their diverse sizes make them deployable in environments ranging from…

Open weights apache-2.0 79M parameters 131,072 tokens transformers

Model · Any to any

gemma-4-E4B-it-GGUF

GGML Org

Run with https://llama.app - https://huggingface.co/google/gemma-4-E4B-it - https://huggingface.co/google/gemma-4-E4B-it-assistant - https://huggingface.co/google/gemma-4-E4B-it-qat-q40-unquantized-assistant - https://huggingface.co/google/gemma-4-E4B-it-qat-q40-unquantized - add info - add dflash

Open weights apache-2.0

Model · Any to any

gemma-4-12B-it-qat-GGUF

Unsloth AI

This model ships a Multi-Token Prediction drafter at the repo root (mtp-gemma-4-12B-it.gguf, a near-lossless smart Q40). A recent llama.cpp auto-discovers it from -hf, so you do not pass --model-draft: The drafter shares the target's KV cache and does not change the output (the target verifies every drafted token). See the MTP/ folder for the other precisions and explicit usage. Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context…

Open weights apache-2.0 transformers

Model · Any to any

gemma-4-12B-it-qat-q4_0-gguf

Google

Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in five distinct sizes: E2B, E4B, 12B, 26B A4B, and 31B. Their diverse sizes make them deployable in environments ranging from…

Open weights apache-2.0 transformers

Model · Any to any

gemma-4-E4B-it-qat-q4_0-gguf

Google

Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in five distinct sizes: E2B, E4B, 12B, 26B A4B, and 31B. Their diverse sizes make them deployable in environments ranging from…

Open weights apache-2.0