SAVRN Model Hub · Comparisons
gemma-3-4b-it vs Qwen3.5-4B
Gemma-3-4b-it has 4.3B parameters and Qwen3.5-4B has 4.7B parameters; gemma-3-4b-it is released under Gemma Terms of Use and Qwen3.5-4B under Apache License 2.0; at 16-bit, gemma-3-4b-it needs about 10.3 GB (1x MI300X from $1.85 an hour) and Qwen3.5-4B about 11.2 GB (1x MI300X from $1.85 an hour).
| Field | gemma-3-4b-it google/gemma-3-4b-it | Qwen3.5-4B Qwen/Qwen3.5-4B |
|---|---|---|
| Publisher | Qwen | |
| Task | Image and text to text | Image and text to text |
| Modality | Image and text | Image and text |
| Parameters, as reported | 4.3B parameters | 4.7B parameters |
| Architecture | Gemma3ForConditionalGeneration | Qwen3_5ForConditionalGeneration |
| Library | transformers | transformers |
| Context length | Not stated | 262,144 tokens |
| Repository size | 8.6 GB | 9.3 GB |
| Artifact formats | safetensors | safetensors |
| License | gemma | apache-2.0 |
| Access | Access requested at publisher | Open weights, no gate |
| Memory at 16-bit (weights and margin) | 10.3 GB | 11.2 GB |
| Cheapest GPUs at 16-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Memory at 4-bit (weights and margin) | 2.6 GB | 2.8 GB |
| Cheapest GPUs at 4-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Revision viewed | 093f9f388b31 | 851bf6e806ef |
| Downloads reported by the hub | 1.8M | 7M |
| Last observed | 2026-09-18 | 2026-09-18 |
An evaluation row appears only where at least two of these models report the same benchmark with the same stated configuration, metric, unit and setup. Different evaluators stay named in each cell. Values are shown as reported: no unit conversion, no ranking.
Other Reported Results
These results are listed for each model on its own, because the conditions needed to compare them are not stated or do not match. Two results that leave a condition blank are not assumed to share it.
gemma-3-4b-it
| Benchmark | Conditions | Result | Reported by | Revision | Date |
|---|---|---|---|---|---|
| Idavidrein/gpqa | Task diamondMetric diamondSetup GPQA DiamondComparison conditions not established | 36.8687 | EvalEval Reported by a third party |
Evaluated revision not stated | 2026-04-18 |
| Idavidrein/gpqa | Task mainMetric mainSetup GPQA chain-of-thoughtComparison conditions not established | 16.3677 | EvalEval Reported by a third party |
Evaluated revision not stated | 2026-06-30 |
| sapbot/ask-my-agent-bench-2 | Task fallbackMetric fallbackComparison conditions not established | 32.4 | Not named Reported by a third party |
Evaluated revision not stated | 2026-06-23 |
Qwen3.5-4B
| Benchmark | Conditions | Result | Reported by | Revision | Date |
|---|---|---|---|---|---|
| Idavidrein/gpqa | Task diamondMetric diamondComparison conditions not established | 76.2 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-03-02 |
| LiquidAI/ifstruct-v1.0 | Task ifstruct_v1Metric ifstruct_v1Comparison conditions not established | 36.25 | Liquid AI — IFStruct v1.0 blog (Qwen3.5-4B) Reported by a third party |
Evaluated revision not stated | 2026-06-30 |
| MMMU/MMMU_Pro | Task mmmu_pro_visionMetric mmmu_pro_visionComparison conditions not established | 66.3 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-28 |
| TIGER-Lab/MMLU-Pro | Task mmlu_proMetric mmlu_proComparison conditions not established | 79.1 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-03-02 |
| likaixin/ScreenSpot-Pro | Task overallMetric overallComparison conditions not established | 60.3 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-03-18 |
| llamaindex/ExtractBench | Task longMetric longSetup Pipeline name: qwen3_5_4b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 27.31 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-26 |
| llamaindex/ExtractBench | Task meanMetric meanSetup Pipeline name: qwen3_5_4b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 82.43 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-26 |
| llamaindex/ExtractBench | Task mediumMetric mediumSetup Pipeline name: qwen3_5_4b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 76.64 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-26 |
| llamaindex/ExtractBench | Task shortMetric shortSetup Pipeline name: qwen3_5_4b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 89.06 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-26 |
| llamaindex/ParseBench | Task chartMetric chartSetup Pipeline name: qwen3_5_4b_vllm_layoutComparison conditions not established | 2.5 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task layoutMetric layoutSetup Pipeline name: qwen3_5_4b_vllm_layoutComparison conditions not established | 19.7 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task meanMetric meanSetup Pipeline name: qwen3_5_4b_vllm_layoutComparison conditions not established | 35.4 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task tableMetric tableSetup Pipeline name: qwen3_5_4b_vllm_layoutComparison conditions not established | 8 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task text_contentMetric text_contentSetup Pipeline name: qwen3_5_4b_vllm_layoutComparison conditions not established | 88.9 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task text_formattingMetric text_formattingSetup Pipeline name: qwen3_5_4b_vllm_layoutComparison conditions not established | 57.8 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
SAVRN's Notes on gemma-3-4b-it
Image and text in, text out, 4.3B parameters. Memory runs 10.3 GB at 16-bit, 5.2 GB at 8-bit and 2.6 GB at 4-bit, so the cheapest Index setup, one MI300X with 192 GB at $1.85 an hour on demand, has most of its card to spare. Plan on it sharing that card with larger tenants.
The license is where to slow down. Gemma Terms of Use allow commercial use and redistribution subject to the Prohibited Use Policy, whose restrictions pass to anyone you distribute to, so treat it as conditional. Access is gated, so the files come from the publisher once you clear it. The page's context field is empty while the publisher describes a 128K window, so confirm it on your stack. It derives from gemma-3-4b-pt. DeepInfra's $0.05 in and $0.10 out per million tokens is the per-token price to beat.
SAVRN's Notes on Qwen3.5-4B
A 262,144-token window on a 4.7B model shapes everything else here. It is built on Qwen3.5-4B-Base and reads images as well as text. At 16-bit it needs 11.2 GB to run, so on the cheapest setup we list, one MI300X with 192 GB at $1.85 an hour on demand, quantizing is a choice, not a requirement; 4-bit brings it to 2.8 GB for several copies on one card.
Apache 2.0 means you can run it commercially, fine-tune it and redistribute what you make, as long as the license and any NOTICE file stay attached and you state significant changes, with a patent grant included. Before committing, run the window length you intend to use and measure memory there; 11.2 GB is the entry ticket, not the ceiling. Released February 27, 2026, it is young; check the publisher's page for revisions before you freeze a version.
Questions
Which is larger, gemma-3-4b-it or Qwen3.5-4B?
Qwen3.5-4B (4.7B parameters) is larger than gemma-3-4b-it (4.3B parameters), by the parameter counts their publishers report.
Which is cheaper to run, gemma-3-4b-it or Qwen3.5-4B?
At 4-bit, gemma-3-4b-it fits on 1x MI300X from $1.85 an hour and Qwen3.5-4B on 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use gemma-3-4b-it commercially?
Yes, with conditions. gemma-3-4b-it is released under Gemma Terms of Use. Gemma models are released under Google's Gemma Terms of Use, which permit commercial use and redistribution subject to the Gemma Prohibited Use Policy, whose restrictions must be passed on to anyone the model is distributed to.
Can I use Qwen3.5-4B commercially?
Yes. Qwen3.5-4B is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.