Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Gemma-4-Writers-31B

by Ateron Ateron/Gemma-4-Writers-31B

Gemma-4-Writers-31B is an open-weight model for text generation from Ateron, released under Apache License 2.0. It has 31.3B parameters and a 262,144-token context. At 16-bit it needs about 75.1 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

"Less Gemma - more human" I had a lot of fresh and creative experience with both ConicCat tunes, but they had some instability issues, that I hopefully fixed there.

Parameters31.3B
Context262,144
Weights62.5 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve Gemma-4-Writers-31B (31.3B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 62.5 GB 75.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 31.3 GB 37.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 15.6 GB 18.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 16, 2026.

Gemma-4-Writers-31B on every accelerator the SAVRN Index prices, at every precision

Model Card

By Ateron, published under apache-2.0, revision b76fb55674fc.

"Less Gemma - more human" I had a lot of fresh and creative experience with both ConicCat tunes, but they had some instability issues, that I hopefully fixed there.

Read Ateron's full model card

Writers

"Less Gemma - more human"

Overview

I had a lot of fresh and creative experience with both ConicCat tunes, but they had some instability issues, that I hopefully fixed there.

Mergekit Configuration

### Phase 1:
della_linear Recipe 1
merge_method: della_linear
base_model: F:\AI\Merge\Gemma-4-it
tokenizer_source: base
dtype: bfloat16
parameters:
  lambda: 1.0
  epsilon: 0.05
  normalize: true
models:
  - model: F:\AI\Merge\Gemma-4-Writer-D
    parameters:
      density: 0.30
      weight:         
        - {filter: mlp.gate_proj, value: 0.25}
        - {filter: mlp.up_proj, value: 0.25}
        - {filter: mlp.down_proj, value: 0.25}
        - {value: 0.40}


  - model: F:\AI\Merge\Gemma-4-Writer-F
    parameters:
      density: 0.40
      weight:
        - {filter: mlp.gate_proj, value: 0.30}
        - {filter: mlp.up_proj, value: 0.30}
        - {filter: mlp.down_proj, value: 0.25}
        - {value: 0.40}

  - model: F:\AI\Merge\Gemma-4-Scotoma-V2
    parameters:
      density: 0.30
      weight:
        - {filter: mlp.gate_proj, value: 0.20}
        - {filter: mlp.up_proj, value: 0.20}
        - {filter: mlp.down_proj, value: 0.40}
        - {value: 0.20}

Special Thanks

  • Google DeepMind: Gemma.
  • The Open-Source Community: People that keep working and sharing their thoughts.
  • Mergekit Fork: Zerofata - merges is an addiction.
  • Tunes: ConicCat for making these work and breathing new life into Gemma.
  • To Nimbz: Cat that keeps me on my toes.

Configuration

Architecture
Gemma4ForConditionalGeneration
Context length (tokens)
262,144
Layers
60
Hidden size
5,376
Feed-forward size
21,504
Attention heads
32
Key/value heads
16
Head dimension
256
Vocabulary size
262,144
Sliding window (tokens)
1,024
Model type
gemma4

Identity and Version

Repository
Ateron/Gemma-4-Writers-31B
Publisher
Ateron
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
31.3B parameters
Languages
en
Revision
b76fb55674fc13ff274cc248db912236f8509d8e
First published
2026-09-30
Last updated
2026-10-02

Files and Weights

22 files, 62.6 GB in total. The weights are 13 files totalling 62.5 GB in safetensors.

Weights13 files · 62.5 GB
Configuration4 files · 128.9 KB
Tokenizer2 files · 32.2 MB
Documentation1 file · 3.1 KB
Other1 file · 19.1 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00013.safetensorsWeights5.0 GB 5a296aefbd53
model-00002-of-00013.safetensorsWeights4.9 GB 9135fb4dfab4
model-00003-of-00013.safetensorsWeights4.9 GB 1098a9e21f49
model-00004-of-00013.safetensorsWeights4.9 GB 56b41dfd5693
model-00005-of-00013.safetensorsWeights4.8 GB 50abaa825dc4
model-00006-of-00013.safetensorsWeights4.9 GB 91c9f773112b
model-00007-of-00013.safetensorsWeights4.9 GB 72da8852d477
model-00008-of-00013.safetensorsWeights4.9 GB 621c96e70ca3
model-00009-of-00013.safetensorsWeights4.8 GB 4a6f18bcde69
model-00010-of-00013.safetensorsWeights4.8 GB 1d52c72883f5
model-00011-of-00013.safetensorsWeights4.9 GB 924a48123b6f
model-00012-of-00013.safetensorsWeights4.9 GB 41ab0d24c117
model-00013-of-00013.safetensorsWeights4.0 GB 932eacc3a968
config.jsonConfiguration4.8 KB —
mergekit_config.ymlConfiguration976 B —
model.safetensors.index.jsonConfiguration121.4 KB —
processor_config.jsonConfiguration1.7 KB —
README.mdDocumentation3.1 KB —
chat_template.jinjaOther19.1 KB —
.gitattributesRepository1.6 KB —
tokenizer.jsonTokenizer32.2 MB cc8d3a0ce364
tokenizer_config.jsonTokenizer3.8 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
62.5 GB
Download from Ateron

Released by Ateron through its official repository on Hugging Face. Read the license.

Built From

  • Derived from ConicCat/Gemma4-Writer-31B-D
  • Derived from ConicCat/Gemma4-Writer-31B-F
  • Derived from ReadyArt/gemma-4-31B-it-scotoma-2
  • Merged from ConicCat/Gemma4-Writer-31B-D
  • Merged from ConicCat/Gemma4-Writer-31B-F
  • Merged from ReadyArt/gemma-4-31B-it-scotoma-2

Memory Requirements

PrecisionWeights in memory
As published62.5 GB
16-bit62.5 GB
8-bit31.3 GB
4-bit15.6 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Questions About Gemma-4-Writers-31B

How much GPU memory does Gemma-4-Writers-31B need?

About 75.1 GB at 16-bit and 18.8 GB at 4-bit: the weights (31.3B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Gemma-4-Writers-31B on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use Gemma-4-Writers-31B commercially?

Yes. Gemma-4-Writers-31B is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is Gemma-4-Writers-31B's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

OTel-2.0-LLM-31B-IT

Farbod Tavakkoli

OTel-2.0-LLM-31B-IT is a telecom-specialized instruction model post-trained from Gemma 4 31B-IT on approximately 440 billion telecom training tokens. It is the first release in the OTel 2.0 family and is designed to support telco-grade AI workflows across network operations, standards interpretation, product development, network configuration assistance, RAG, and telecom-specific question answering. OTel 2.0 extends the original OTel effort from a RAG-oriented telecom fine-tuning release into a larger domain-adapted training program. The model was trained from a much larger standards and telecom corpus, with new data preparation coverage for direct telecom QnA, abstention, RAG…

Open weights apache-2.0 31.3B parameters 262,144 tokens transformers

Model · Text generation

GLM-4.7-Flash

Z.ai

Join our Discord community. Check out the GLM-4.7 technical blog, technical report(GLM-4.5). Use GLM-4.7-Flash API services on Z.ai API Platform. One click to GLM-4.7. GLM-4.7-Flash is a 30B-A3B MoE model. As the strongest model in the 30B class, GLM-4.7-Flash offers a new option for lightweight deployment that balances performance and efficiency. Default Settings (Most Tasks) For multi-turn agentic tasks (τ²-Bench and Terminal Bench 2), please turn on Preserved Thinking mode. Terminal Bench, SWE Bench Verified τ^2-Bench For τ^2-Bench evaluation, we added an additional prompt to the Retail and Telecom user interaction to avoid failure modes caused by users ending the interaction…

Open weights mit 31.2B parameters 202,752 tokens transformers

Model · Text generation

glm47-flash-blockwise-fp8

RadixArk

Blockwise FP8 quantization of zai-org/GLM-4.7-Flash: e4m3 weights with one scale per 128×128 block and dynamic activation scaling, about half the size of the BF16 original (30 GiB vs 58 GiB). See the original model card for model details. gsm8k (5-shot, full test set) on SGLang with MTP speculative decoding: 0.809 for FP8 vs 0.819 for BF16; average accept length 2.41 vs 2.43. Attention tensor parallelism must be 1 or 2: at 4, each rank's kvbproj shard (2240 rows) is not a multiple of the 128-row block. For more GPUs, use DP attention with expert parallelism, for example --tp-size 4 --dp-size 4 --enable-dp-attention --ep-size 4 --moe-a2a-backend deepep --cuda-graph-max-bs-decode 128. MIT…

Open weights mit 31.2B parameters 202,752 tokens transformers

Model · Text generation

Qwen3-VL-30B-A3B-Instruct-AWQ

QuantTrio

As of 2025-10-08, create a fresh Python environment and run: For more details, refer to vLLM Official Qwen3-VL Guide Meet Qwen3-VL — the most powerful vision-language model in the Qwen series to date. This generation delivers comprehensive upgrades across the board: superior text understanding & generation, deeper visual perception & reasoning, extended context length, enhanced spatial and video dynamics comprehension, and stronger agent interaction capabilities. Available in Dense and MoE architectures that scale from edge to cloud, with Instruct and reasoning‑enhanced Thinking editions for flexible, on‑demand deployment. Text Understanding on par with pure LLMs: Seamless text–vision…

Open weights apache-2.0 31.1B parameters 262,144 tokens transformers

Model · Text generation

NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

NVIDIA

September 2025 \- December 2025 The post-training data has a cutoff date of November 28, 2025\. The pre-training data has a cutoff date of June 25, 2025\. Nemotron-3-Nano-30B-A3B-BF16 is a large language model (LLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response. The model's reasoning capabilities can be configured through a flag in the chat template. If the user prefers the model to provide its final answer without intermediate reasoning traces, it can be configured to do so, albeit with a slight decrease in…

Open weights other 31.6B parameters 262,144 tokens transformers