SAVRN Model Hub · Comparisons
gemma-4-26B-A4B-it vs Qwen3.6-27B
Gemma-4-26B-A4B-it has 25.8B parameters and Qwen3.6-27B has 27.8B parameters; both are released under Apache License 2.0; at 16-bit, gemma-4-26B-A4B-it needs about 61.9 GB (1x MI300X from $1.85 an hour) and Qwen3.6-27B about 66.7 GB (1x MI300X from $1.85 an hour).
| Field | gemma-4-26B-A4B-it google/gemma-4-26B-A4B-it | Qwen3.6-27B Qwen/Qwen3.6-27B |
|---|---|---|
| Publisher | Qwen | |
| Task | Image and text to text | Image and text to text |
| Modality | Image and text | Image and text |
| Parameters, as reported | 25.8B parameters | 27.8B parameters |
| Architecture | Gemma4ForConditionalGeneration | Qwen3_5ForConditionalGeneration |
| Library | transformers | transformers |
| Context length | 262,144 tokens | 262,144 tokens |
| Repository size | 51.6 GB | 55.6 GB |
| Artifact formats | safetensors | safetensors |
| License | apache-2.0 | apache-2.0 |
| Access | Open weights, no gate | Open weights, no gate |
| Memory at 16-bit (weights and margin) | 61.9 GB | 66.7 GB |
| Cheapest GPUs at 16-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Memory at 4-bit (weights and margin) | 15.5 GB | 16.7 GB |
| Cheapest GPUs at 4-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Revision viewed | 4d7ae4984b7d | 6a9e13bd6fc8 |
| Downloads reported by the hub | 9.8M | 3.7M |
| Last observed | 2026-09-18 | 2026-09-18 |
An evaluation row appears only where at least two of these models report the same benchmark with the same stated configuration, metric, unit and setup. Different evaluators stay named in each cell. Values are shown as reported: no unit conversion, no ranking.
Other Reported Results
These results are listed for each model on its own, because the conditions needed to compare them are not stated or do not match. Two results that leave a condition blank are not assumed to share it.
gemma-4-26B-A4B-it
| Benchmark | Conditions | Result | Reported by | Revision | Date |
|---|---|---|---|---|---|
| Idavidrein/gpqa | Task diamondMetric diamondComparison conditions not established | 82.3 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-02 |
| MMMU/MMMU_Pro | Task mmmu_pro_visionMetric mmmu_pro_visionComparison conditions not established | 73.8 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-05-12 |
| TIGER-Lab/MMLU-Pro | Task mmlu_proMetric mmlu_proComparison conditions not established | 82.6 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-02 |
| cais/hle | Task hleMetric hleSetup With searchComparison conditions not established | 17.2 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-02 |
| llamaindex/ExtractBench | Task longMetric longSetup Pipeline name: gemma4_26b_vllm_extract_oneshot_structured_output_file; self-hosted on vLLM, one-shot JSON-Schema structured outputComparison conditions not established | 28.88 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-26 |
| llamaindex/ExtractBench | Task meanMetric meanSetup Pipeline name: gemma4_26b_vllm_extract_oneshot_structured_output_file; self-hosted on vLLM, one-shot JSON-Schema structured outputComparison conditions not established | 70.27 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-26 |
| llamaindex/ExtractBench | Task mediumMetric mediumSetup Pipeline name: gemma4_26b_vllm_extract_oneshot_structured_output_file; self-hosted on vLLM, one-shot JSON-Schema structured outputComparison conditions not established | 59.61 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-26 |
| llamaindex/ExtractBench | Task shortMetric shortSetup Pipeline name: gemma4_26b_vllm_extract_oneshot_structured_output_file; self-hosted on vLLM, one-shot JSON-Schema structured outputComparison conditions not established | 77.7 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-26 |
| llamaindex/ParseBench | Task chartMetric chartSetup Pipeline name: gemma4_26b_vllm_with_layoutComparison conditions not established | 14.2 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task layoutMetric layoutSetup Pipeline name: gemma4_26b_vllm_with_layoutComparison conditions not established | 59.2 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task meanMetric meanSetup Pipeline name: gemma4_26b_vllm_with_layoutComparison conditions not established | 58.5 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task tableMetric tableSetup Pipeline name: gemma4_26b_vllm_with_layoutComparison conditions not established | 70 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task text_contentMetric text_contentSetup Pipeline name: gemma4_26b_vllm_with_layoutComparison conditions not established | 83.8 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
| llamaindex/ParseBench | Task text_formattingMetric text_formattingSetup Pipeline name: gemma4_26b_vllm_with_layoutComparison conditions not established | 65.1 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-14 |
Qwen3.6-27B
| Benchmark | Conditions | Result | Reported by | Revision | Date |
|---|---|---|---|---|---|
| Idavidrein/gpqa | Task diamondMetric diamondComparison conditions not established | 87.8 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| MMMU/MMMU_Pro | Task mmmu_pro_visionMetric mmmu_pro_visionComparison conditions not established | 75.8 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-05-15 |
| MathArena/aime_2026 | Task MathArena/aime_2026Metric MathArena/aime_2026Comparison conditions not established | 94.1 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| MathArena/hmmt_feb_2026 | Task MathArena/hmmt_feb_2026Metric MathArena/hmmt_feb_2026Comparison conditions not established | 84.3 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| SWE-bench/SWE-bench_Multilingual | Task swe_bench_multilingual_%_resolvedMetric swe_bench_multilingual_%_resolvedComparison conditions not established | 71.3 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-08-10 |
| SWE-bench/SWE-bench_Verified | Task swe_bench_%_resolvedMetric swe_bench_%_resolvedComparison conditions not established | 77.2 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| ScaleAI/SWE-bench_Pro | Task SWE_Bench_ProMetric SWE_Bench_ProComparison conditions not established | 53.5 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| TIGER-Lab/MMLU-Pro | Task mmlu_proMetric mmlu_proComparison conditions not established | 86.2 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| benchflow/skillsbench | Task skillsbench_v1_1Metric skillsbench_v1_1Setup SkillsBench Avg5. Evaluated via OpenCode on 78 tasks (self-contained subset, excluding API-dependent tasks); avg of 5 runs. Mapped to the Hub's benchflow/skillsbench task skillsbench_v1_1.Comparison conditions not established | 48.2 | Qwen3.6-27B model card — Benchmark Results (Language > Coding Agent) Reported by a third party |
Evaluated revision not stated | 2026-04-21 |
| cais/hle | Task hleMetric hleComparison conditions not established | 24 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| harborframework/terminal-bench-2.0 | Task terminalbench_2Metric terminalbench_2Setup Harbor/Terminus-2 harness; 3h timeout, 32 CPU/48 GB RAM; temp=1.0, top_p=0.95, top_k=20, max_tokens=80K, 256K ctx; avg of 5 runs.Comparison conditions not established | 59.3 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-06-23 |
| internlm/WildClawBench | Task avg_costMetric avg_costComparison conditions not established | 20.91 | WildClawBench Reported by a third party |
Evaluated revision not stated | 2026-08-11 |
| internlm/WildClawBench | Task avg_timeMetric avg_timeComparison conditions not established | 421 | WildClawBench Reported by a third party |
Evaluated revision not stated | 2026-08-11 |
| internlm/WildClawBench | Task overallMetric overallComparison conditions not established | 43.2 | WildClawBench Reported by a third party |
Evaluated revision not stated | 2026-08-11 |
SAVRN's Notes on Qwen3.6-27B
Two hosts on the SAVRN Index sell this model by the token, so renting and owning can be priced side by side. With 27.8B parameters, images and text in, text out, it needs 66.7 GB at 16-bit, which fits one 192 GB MI300X, the cheapest listed setup at $1.85 an hour on-demand. Eight-bit drops the need to 33.3 GB and 4-bit to 16.7 GB, so one card carries several copies.
Renting: DeepInfra lists $0.32 input and $3.20 output per million tokens, OVHcloud $0.47 and $3.19. Price your monthly token volume both ways before choosing. Apache 2.0 permits commercial use, modification and redistribution, notices kept and changes stated, so a fine-tune is yours to ship. Verify the 262,144-token context, and note the config's architecture is Qwen3_5ForConditionalGeneration, model type qwen3_5, despite the 3.6 name, so confirm your serving stack loads it. No base model or paper is on record.
Questions
Which is larger, gemma-4-26B-A4B-it or Qwen3.6-27B?
Qwen3.6-27B (27.8B parameters) is larger than gemma-4-26B-A4B-it (25.8B parameters), by the parameter counts their publishers report.
Which is cheaper to run, gemma-4-26B-A4B-it or Qwen3.6-27B?
At 4-bit, gemma-4-26B-A4B-it fits on 1x MI300X from $1.85 an hour and Qwen3.6-27B on 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use gemma-4-26B-A4B-it commercially?
Yes. gemma-4-26B-A4B-it is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
Can I use Qwen3.6-27B commercially?
Yes. Qwen3.6-27B is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.