SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

gemma-3-4b-it

by Google google/gemma-3-4b-it

[Gemma 3 Technical Report][g3-tech-report] [Responsible Generative AI Toolkit][rai-toolkit] [Gemma on Kaggle][kaggle-gemma] [Gemma on Vertex Model Garden][vertex-mg-gemma3] Summary description and brief definition of inputs and outputs.

Parameters4.3B
Context
Weights8.6 GB
Licensegemma
AccessAccess requested at publisher
Monthly Downloads1.8M

Runs On

What it takes to serve gemma-3-4b-it (4.3B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 8.6 GB 10.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 4.3 GB 5.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 2.2 GB 2.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on gemma-3-4b-it

Image and text in, text out, 4.3B parameters. Memory runs 10.3 GB at 16-bit, 5.2 GB at 8-bit and 2.6 GB at 4-bit, so the cheapest Index setup, one MI300X with 192 GB at $1.85 an hour on demand, has most of its card to spare. Plan on it sharing that card with larger tenants.

The license is where to slow down. Gemma Terms of Use allow commercial use and redistribution subject to the Prohibited Use Policy, whose restrictions pass to anyone you distribute to, so treat it as conditional. Access is gated, so the files come from the publisher once you clear it. The page's context field is empty while the publisher describes a 128K window, so confirm it on your stack. It derives from gemma-3-4b-pt. DeepInfra's $0.05 in and $0.10 out per million tokens is the per-token price to beat.

Model Card

[Gemma 3 Technical Report][g3-tech-report] [Responsible Generative AI Toolkit][rai-toolkit] [Gemma on Kaggle][kaggle-gemma] [Gemma on Vertex Model Garden][vertex-mg-gemma3] Summary description and brief definition of inputs and outputs. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. Gemma 3 models are multimodal, handling text and image input and generating text output, with open weights for both pre-trained variants and instruction-tuned variants. Gemma 3 has a large, 128K context window, multilingual support in over 140 languages, and is available in more sizes than previous…

Excerpt from the card by Google, licensed gemma.

Identity and Version

Repository
google/gemma-3-4b-it
Publisher
Google
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
4.3B parameters
Languages
Not stated by the source
Revision
093f9f388b31de276ce2de164bdc2081324b9767
First published
2025-02-20
Last updated
2025-03-21

Files and Weights

15 files, 8.6 GB in total. The weights are 2 files totalling 8.6 GB in safetensors.

Weights2 files · 8.6 GB
Configuration8 files · 94.6 KB
Tokenizer3 files · 39.2 MB
Documentation1 file · 25.1 KB
Repository1 file · 1.8 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00002.safetensorsWeights5.0 GB
model-00002-of-00002.safetensorsWeights3.6 GB
added_tokens.jsonConfiguration35 B
chat_template.jsonConfiguration1.6 KB
config.jsonConfiguration855 B
generation_config.jsonConfiguration215 B
model.safetensors.index.jsonConfiguration90.6 KB
preprocessor_config.jsonConfiguration570 B
processor_config.jsonConfiguration70 B
special_tokens_map.jsonConfiguration662 B
README.mdDocumentation25.1 KB
.gitattributesRepository1.8 KB
tokenizer.jsonTokenizer33.4 MB
tokenizer.modelTokenizer4.7 MB
tokenizer_config.jsonTokenizer1.2 MB

License and Download

License
gemma
Access
Access requested at publisher
Download size
8.6 GB
Download from Google

Released by Google through Kaggle.

Built From

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
Idavidrein/gpqa Task diamondMetric diamondSetup GPQA DiamondComparison conditions not established 36.8687 EvalEval
Reported by a third party
Evaluated revision not stated 2026-04-18
Idavidrein/gpqa Task mainMetric mainSetup GPQA chain-of-thoughtComparison conditions not established 16.3677 EvalEval
Reported by a third party
Evaluated revision not stated 2026-06-30
sapbot/ask-my-agent-bench-2 Task fallbackMetric fallbackComparison conditions not established 32.4 Not named
Reported by a third party
Evaluated revision not stated 2026-06-23

Memory Requirements

PrecisionWeights in memory
As published8.6 GB
16-bit8.6 GB
8-bit4.3 GB
4-bit2.2 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Hosted Prices

HostInput / outputUnitObserved
DeepInfra$0.05 / $0.10input / output, per million tokensSep 18, 2026

From the SAVRN Index.

Compare gemma-3-4b-it

Questions About gemma-3-4b-it

How much GPU memory does gemma-3-4b-it need?

About 10.3 GB at 16-bit and 2.6 GB at 4-bit: the weights (4.3B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run gemma-3-4b-it on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use gemma-3-4b-it commercially?

Yes, with conditions. gemma-3-4b-it is released under Gemma Terms of Use. Gemma models are released under Google's Gemma Terms of Use, which permit commercial use and redistribution subject to the Gemma Prohibited Use Policy, whose restrictions must be passed on to anyone the model is distributed to.

Similar Models

Model · Image and text to text

medgemma-4b-it

Google

Model on Google Cloud Model Garden: MedGemma GitHub repository (supporting code, Colab notebooks, discussions, and Foundations terms of use](https://developers.google.com/health-ai-developer-foundations/terms). This section describes the MedGemma model and how to use it. MedGemma is a collection of Gemma 3 variants that are trained for performance on medical text and image comprehension. Developers can use MedGemma to accelerate building healthcare-based AI applications. MedGemma currently comes in three variants: a 4B multimodal version and 27B text-only and multimodal versions. Both MedGemma multimodal versions utilize a SigLIP image encoder that has been specifically pre-trained on a…

Access requested at publisher other 4.3B parameters transformers

Model · Image and text to text

Qwen3-VL-4B-Instruct

Qwen

Meet Qwen3-VL — the most powerful vision-language model in the Qwen series to date. This generation delivers comprehensive upgrades across the board: superior text understanding & generation, deeper visual perception & reasoning, extended context length, enhanced spatial and video dynamics comprehension, and stronger agent interaction capabilities. Available in Dense and MoE architectures that scale from edge to cloud, with Instruct and reasoning‑enhanced Thinking editions for flexible, on‑demand deployment. Text Understanding on par with pure LLMs: Seamless text–vision fusion for lossless, unified comprehension. 1. Interleaved-MRoPE: Full‑frequency allocation over time, width, and height…

Open weights apache-2.0 4.4B parameters 262,144 tokens transformers

Model · Image and text to text

Rex-Omni

IDEA-Research

This model is Rex-Omni, a 3B-parameter Multimodal Large Language Model (MLLM) presented in the paper "Detect Anything via Next Point Prediction". It is compatible with the Hugging Face transformers library and is licensed under the IDEA License 1.0. src="https://img.shields.io/badge/RexOmni-Website-BADFDB?style=flat-square&logo=deno&logoColor=violet&color=BADFDB" alt="RexThinker Website" src="https://img.shields.io/badge/RexOmni-Paper-Red%25red?logo=arxiv&logoColor=red&color=yellow" alt="RexThinker Paper on arXiv" src="https://img.shields.io/badge/RexOmni-Weight-orange?logo=huggingface&logoColor=yellow" alt="RexThinker weight on Hugging Face"…

Open weights other 4.1B parameters 128,000 tokens transformers

Model · Image and text to text

Omni-Edu-4B

Hao Liang

This model is a fine-tuned version of Qwen/Qwen3.5-4B-Base on the Omni-Edu-70K dataset. The following hyperparameters were used during training: - learningrate: 5e-06 - trainbatchsize: 1 - evalbatchsize: 8 - distributedtype: multi-GPU - numdevices: 8 - gradientaccumulationsteps: 8 - totaltrainbatchsize: 64 - totalevalbatchsize: 64 - lrschedulertype: cosine - lrschedulerwarmupsteps: 0.1 - numepochs: 3.0 - Transformers 5.2.0 - Pytorch 2.10.0 - Datasets 4.0.0 - Tokenizers 0.22.2

Open weights other 4.5B parameters 262,144 tokens transformers

Model · Image and text to text

blip2-flan-t5-xl

Salesforce AI Research

BLIP-2 model, leveraging Flan T5-xl (a large language model). It was introduced in the paper BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models by Li et al. and first released in this repository. Disclaimer: The team releasing BLIP-2 did not write a model card for this model so this model card has been written by the Hugging Face team. BLIP-2 consists of 3 models: a CLIP-like image encoder, a Querying Transformer (Q-Former) and a large language model. The authors initialize the weights of the image encoder and large language model from pre-trained checkpoints and keep them frozen while training the Querying Transformer, which is a…

Open weights mit 3.9B parameters transformers

Model · Image and text to text

Qwen3.5-4B

Qwen

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. Empty cells (--) indicate scores not…

Open weights apache-2.0 4.7B parameters 262,144 tokens transformers