SAVRN Model Hub · Comparisons
gemma-4-12B-it vs gemma-4-E4B-it-qat-w4a16-ct
Gemma-4-12B-it has 12B parameters and gemma-4-E4B-it-qat-w4a16-ct has 8.7B parameters; both are released under Apache License 2.0; at 16-bit, gemma-4-12B-it needs about 28.7 GB (1x MI300X from $1.85 an hour) and gemma-4-E4B-it-qat-w4a16-ct about 21 GB (1x MI300X from $1.85 an hour).
| Field | gemma-4-12B-it google/gemma-4-12B-it | gemma-4-E4B-it-qat-w4a16-ct google/gemma-4-E4B-it-qat-w4a16-ct |
|---|---|---|
| Publisher | ||
| Task | Any to any | Any to any |
| Modality | Multimodal | Multimodal |
| Parameters, as reported | 12B parameters | 8.7B parameters |
| Architecture | Gemma4UnifiedForConditionalGeneration | Gemma4ForConditionalGeneration |
| Library | transformers | transformers |
| Context length | 262,144 tokens | 131,072 tokens |
| Repository size | 24.0 GB | 11.5 GB |
| Artifact formats | safetensors | safetensors |
| License | apache-2.0 | apache-2.0 |
| Access | Open weights, no gate | Open weights, no gate |
| Memory at 16-bit (weights and margin) | 28.7 GB | 21 GB |
| Cheapest GPUs at 16-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Memory at 4-bit (weights and margin) | 7.2 GB | 5.2 GB |
| Cheapest GPUs at 4-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Revision viewed | 707f0a3b8a3c | 6cd26aaa2357 |
| Downloads reported by the hub | 2.7M | 324.3k |
| Last observed | 2026-09-18 | 2026-09-18 |
An evaluation row appears only where at least two of these models report the same benchmark with the same stated configuration, metric, unit and setup. Different evaluators stay named in each cell. Values are shown as reported: no unit conversion, no ranking.
Other Reported Results
These results are listed for each model on its own, because the conditions needed to compare them are not stated or do not match. Two results that leave a condition blank are not assumed to share it.
gemma-4-12B-it
| Benchmark | Conditions | Result | Reported by | Revision | Date |
|---|---|---|---|---|---|
| Idavidrein/gpqa | Task diamondMetric diamondComparison conditions not established | 78.8 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-05-23 |
| MMMU/MMMU_Pro | Task mmmu_proMetric mmmu_proComparison conditions not established | 69.1 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-05-23 |
| MathArena/aime_2026 | Task MathArena/aime_2026Metric MathArena/aime_2026Setup No toolsComparison conditions not established | 77.5 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-05-23 |
| TIGER-Lab/MMLU-Pro | Task mmlu_proMetric mmlu_proComparison conditions not established | 77.2 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-05-23 |
| cais/hle | Task hleMetric hleSetup No toolsComparison conditions not established | 5.2 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-05-23 |
| llamaindex/ExtractBench | Task longMetric longSetup Pipeline name: gemma4_12b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 13.16 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-24 |
| llamaindex/ExtractBench | Task meanMetric meanSetup Pipeline name: gemma4_12b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 45.39 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-24 |
| llamaindex/ExtractBench | Task mediumMetric mediumSetup Pipeline name: gemma4_12b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 30.82 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-24 |
| llamaindex/ExtractBench | Task shortMetric shortSetup Pipeline name: gemma4_12b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 53.62 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-24 |
SAVRN's Notes on gemma-4-12B-it
Text and images in, audio too on this size, text out, 140-plus languages, a 256K-token window: that is Google's instruction-tuned Gemma 4 12B. The footprint is 28.7 GB at 16-bit, 14.4 GB at 8-bit and 7.2 GB at 4-bit, all three on one MI300X at $1.85 per hour with 192 GB to work in, so the question is not which card but how much of it you leave for a 262,144-token context and its neighbors.
Nothing in Apache 2.0 stops you: commercial use, modification and redistribution, with license and NOTICE files kept and changes stated. It derives from google/gemma-4-12B, the pre-trained base, so start there for your own tuning, and read arXiv:2607.02770 first. The scores here, 78.8 on GPQA diamond among them, are model card numbers, not ours; run your own documents. No Index host prices it by the token; the comparison is the card hour.
SAVRN's Notes on gemma-4-E4B-it-qat-w4a16-ct
Five gigabytes, 5.2 to be exact, is what this Gemma 4 E4B build needs at 4-bit, and that number is why it exists. Google quantized it from google/gemma-4-E4B-it-qat-q4_0-unquantized. It takes text, image and audio input, writes text, and carries 8.7 billion parameters with a 131,072 token context. Even at 16-bit it needs 21 GB, so the cheapest rental we track, one MI300X at $1.85 an hour, leaves most of its 192 GB idle. Think small card, or several copies on one large card.
Apache 2.0 keeps the deployment simple: commercial use, modification and redistribution are allowed if you keep the license, copyright and NOTICE files and state significant changes, and it includes a patent grant. Check the context figure before planning around it: the family card cites up to 256K tokens, but this checkpoint's configuration reads 131,072 with a 512 token sliding window. No Index host prices it per token yet. The report is arXiv:2607.02770.
Questions
Which is larger, gemma-4-12B-it or gemma-4-E4B-it-qat-w4a16-ct?
gemma-4-12B-it (12B parameters) is larger than gemma-4-E4B-it-qat-w4a16-ct (8.7B parameters), by the parameter counts their publishers report.
Which is cheaper to run, gemma-4-12B-it or gemma-4-E4B-it-qat-w4a16-ct?
At 4-bit, gemma-4-12B-it fits on 1x MI300X from $1.85 an hour and gemma-4-E4B-it-qat-w4a16-ct on 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use gemma-4-12B-it commercially?
Yes. gemma-4-12B-it is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
Can I use gemma-4-E4B-it-qat-w4a16-ct commercially?
Yes. gemma-4-E4B-it-qat-w4a16-ct is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.