SAVRN
Search Contact SAVRN

Open-weight model · Text generation

gemma-2-9b-it

by Google google/gemma-2-9b-it

[Responsible Generative AI Toolkit][rai-toolkit] [Gemma on Kaggle][kaggle-gemma] [Gemma on Vertex Model Garden][vertex-mg-gemma] Summary description and brief definition of inputs and outputs.

Parameters9.2B
Context
Weights18.5 GB
Licensegemma
AccessAccess requested at publisher
Monthly Downloads757.3k

Runs On

What it takes to serve gemma-2-9b-it (9.2B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 18.5 GB 22.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 9.2 GB 11.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.6 GB 5.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on gemma-2-9b-it

Two words in this record settle more than the memory figures do: gated and conditional. The instruction-tuned 9.2B build needs 22.2 GB of memory at 16-bit, 11.1 GB at 8-bit and 5.5 GB at 4-bit, and the cheapest card the SAVRN Index prices is one 192 GB MI300X at $1.85 an hour. That is a one-card model at any precision. The tuning separates it from google/gemma-2-9b, its base.

Access is gated, so the publisher releases the files only after you clear its access step, and the Gemma Terms of Use permit commercial use subject to the Gemma Prohibited Use Policy, whose restrictions you must pass on to anyone you hand a copy to. Write that clause into your contracts before shipping. No context length is listed, so verify the window before promising a document size. The GPQA and LEXam rows are third-party reported, not reproduced by us.

Model Card

[Responsible Generative AI Toolkit][rai-toolkit] [Gemma on Kaggle][kaggle-gemma] [Gemma on Vertex Model Garden][vertex-mg-gemma] Summary description and brief definition of inputs and outputs. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. They are text-to-text, decoder-only large language models, available in English, with open weights for both pre-trained variants and instruction-tuned variants. Gemma models are well-suited for a variety of text generation tasks, including question answering, summarization, and reasoning. Their relatively small size makes it possible to deploy them…

Excerpt from the card by Google, licensed gemma.

Identity and Version

Repository
google/gemma-2-9b-it
Publisher
Google
Task
Text generation
Modality
Text
Library
transformers
Parameters
9.2B parameters
Languages
Not stated by the source
Revision
11c9b309abf73637e4b6f9a3fa1e92e615547819
First published
2024-06-24
Last updated
2024-08-27

Files and Weights

14 files, 18.5 GB in total. The weights are 4 files totalling 18.5 GB in safetensors.

Weights4 files · 18.5 GB
Configuration4 files · 40.7 KB
Tokenizer3 files · 21.8 MB
Documentation1 file · 25.8 KB
Other1 file · 9.2 MB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00004.safetensorsWeights4.9 GB
model-00002-of-00004.safetensorsWeights4.9 GB
model-00003-of-00004.safetensorsWeights5.0 GB
model-00004-of-00004.safetensorsWeights3.7 GB
config.jsonConfiguration857 B
generation_config.jsonConfiguration173 B
model.safetensors.index.jsonConfiguration39.1 KB
special_tokens_map.jsonConfiguration636 B
README.mdDocumentation25.8 KB
transformers/transformers-4.42.0.dev0-py3-none-any.whlOther9.2 MB
.gitattributesRepository1.7 KB
tokenizer.jsonTokenizer17.5 MB
tokenizer.modelTokenizer4.2 MB
tokenizer_config.jsonTokenizer47.0 KB

License and Download

License
gemma
Access
Access requested at publisher
Download size
18.5 GB
Download from Google

Released by Google through Kaggle.

Built From

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
Idavidrein/gpqa Task diamondMetric diamondSetup GPQA DiamondComparison conditions not established 39.3939 EvalEval
Reported by a third party
Evaluated revision not stated 2026-04-18
Idavidrein/gpqa Task mainMetric mainSetup GPQA chain-of-thoughtComparison conditions not established 23.7668 EvalEval
Reported by a third party
Evaluated revision not stated 2026-06-30
LEXam-Benchmark/LEXam Task mcq_4_choicesMetric mcq_4_choicesComparison conditions not established 25.36 LEXam Leaderboard
Reported by a third party
Evaluated revision not stated 2026-06-02
LEXam-Benchmark/LEXam Task open_questionMetric open_questionComparison conditions not established 27.41 LEXam Leaderboard
Reported by a third party
Evaluated revision not stated 2026-06-02

Memory Requirements

PrecisionWeights in memory
As published18.5 GB
16-bit18.5 GB
8-bit9.2 GB
4-bit4.6 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About gemma-2-9b-it

How much GPU memory does gemma-2-9b-it need?

About 22.2 GB at 16-bit and 5.5 GB at 4-bit: the weights (9.2B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run gemma-2-9b-it on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use gemma-2-9b-it commercially?

Yes, with conditions. gemma-2-9b-it is released under Gemma Terms of Use. Gemma models are released under Google's Gemma Terms of Use, which permit commercial use and redistribution subject to the Gemma Prohibited Use Policy, whose restrictions must be passed on to anyone the model is distributed to.

Similar Models

Model · Text generation

dQwen3.5-9B-Base

IFML

A masked diffusion language model adapted from Qwen3.5-9B. The backbone is hybrid: only its attention layers are made bidirectional, and the Gated DeltaNet layers stay causal. This is a base model, with no instruction tuning. Paper: dQwen3.5: Hybrid-Attention Diffusion Language Models. Code: https://github.com/AntonXue/dQwen Needs a CUDA GPU and transformers>=5.13 (tested with torch 2.7.1+cu128, flash-linear-attention 0.5.1). generate decodes the whole canvas at once, committing positions above a confidence threshold (tau=0.9); pass blocklength=32 for left-to-right block decoding, or tau=None, stepsperblock=k for a fixed budget. The 50B-token checkpoint from the paper is…

Open weights apache-2.0 9B parameters 262,144 tokens transformers

Model · Text generation

idefics-9b

HuggingFaceM4

How do I pronounce the model's name? Watch a Youtube tutorial IDEFICS (Image-aware Decoder Enhanced à la Flamingo with Interleaved Cross-attentionS) is an open-access reproduction of Flamingo, a closed-source visual language model developed by Deepmind. Like GPT-4, the multimodal model accepts arbitrary sequences of image and text inputs and produces text outputs. IDEFICS is built solely on publicly available data and models. The model can answer questions about images, describe visual contents, create stories grounded on multiple images, or simply behave as a pure language model without visual inputs. IDEFICS is on par with the original closed-source model on various image-text benchmarks…

Open weights other 8.9B parameters 2,048 tokens transformers

This model is a fine-tuned version of LiquidAI/LFM2.5-8B-A1B, adapted on the angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k dataset for English text-generation and reasoning-style responses. The fine-tuning run used a custom Convergent Intelligence optimizer stack, CIxOpt, designed for heterogeneous routing across parameter types. The goal of this checkpoint is to test whether a Liquid Foundation Model backbone can be adapted efficiently through targeted sparse participation rather than broad full-model modification. This is an experimental research checkpoint intended for continued evaluation, domain adaptation, and architecture/optimizer testing.…

Open weights apache-2.0 8.5B parameters 128,000 tokens transformers

DuoNeural/LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated-v2 is an apex-tier, uncensored autonomous agentic coding model trained by DuoNeural (Aura, Archon, and Jesse). Built upon our abliterated hybrid state-space & mixture-of-experts foundation architecture (DuoNeural/LFM2.5-8B-A1B-Abliterated), this model activates only 1.5 billion parameters per token out of its 8.3 billion total parameters, delivering blistering inference speeds (~360 tokens/sec on RTX 4080 Super / 3090, and ~80–90 tokens/sec on legacy mobile GPUs like the GTX 1070) while running in under 6 GB VRAM with Q4KM quantization. In our preliminary v1 release, an assistant role delimiter mismatch during training collation…

Open weights other 8.5B parameters 128,000 tokens hermes

DuoNeural/LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated is an apex-tier, uncensored autonomous agentic coding model trained by DuoNeural (Aura, Archon, and Jesse). Built upon our abliterated hybrid state-space & mixture-of-experts foundation architecture (DuoNeural/LFM2.5-8B-A1B-Abliterated), this model activates only 1.5 billion parameters per token out of its 8.3 billion total parameters, delivering blistering inference speeds (~380–400 tokens/sec on consumer GPUs like RTX 3090, and ~90 tokens/sec on legacy GTX 1070 laptops) while fitting in under 6 GB VRAM with Q4KM quantization. 1. Native Hermes Agentic Loop: - Explicit... deliberation before every action. - Structured... containers…

Open weights other 8.5B parameters 128,000 tokens hermes

Model · Text generation

Qwen3-8B-FP8

Qwen

Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features: - Uniquely support of seamless switching between thinking mode (for complex logical reasoning, math, and coding) and non-thinking mode (for efficient, general-purpose dialogue) within single model, ensuring optimal performance across various scenarios. - Significantly enhancement in its reasoning capabilities, surpassing previous QwQ (in thinking mode) and…

Open weights apache-2.0 8.2B parameters 40,960 tokens transformers