Open-weight model
Gemma4-Writer-31B-F-i1-GGUF
by Team Mradermacher mradermacher/Gemma4-Writer-31B-F-i1-GGUF
Gemma4-Writer-31B-F-i1-GGUF is an open-weight model from Team Mradermacher. Its published files total 288.5 GB.
weighted/imatrix quants of https://huggingface.co/ConicCat/Gemma4-Writer-31B-F For a convenient overview and download list, visit our model page for this model.
Model Card
weighted/imatrix quants of https://huggingface.co/ConicCat/Gemma4-Writer-31B-F For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Gemma4-Writer-31B-F-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the…
Excerpt from the card by Team Mradermacher.
Identity and Version
- Repository
- mradermacher/Gemma4-Writer-31B-F-i1-GGUF
- Publisher
- Team Mradermacher
- Task
- Not stated by the source
- Modality
- Other
- Library
- transformers
- Parameters
- Not stated by the source
- Languages
- en
- Revision
- 14123eafa1b4bc0a1a9b08054b0d029d280ed4a8
- First published
- 2026-09-27
- Last updated
- 2026-09-27
Files and Weights
23 files, 288.5 GB in total. The weights are 21 files totalling 288.5 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| Gemma4-Writer-31B-F.i1-IQ1_M.gguf | Weights | 7.7 GB | 79d1a84869f1 |
| Gemma4-Writer-31B-F.i1-IQ1_S.gguf | Weights | 7.2 GB | 124f32a1de9d |
| Gemma4-Writer-31B-F.i1-IQ2_M.gguf | Weights | 10.9 GB | 50608a5a1890 |
| Gemma4-Writer-31B-F.i1-IQ2_S.gguf | Weights | 10.2 GB | 5820c969a90b |
| Gemma4-Writer-31B-F.i1-IQ2_XS.gguf | Weights | 9.5 GB | db6f9a313180 |
| Gemma4-Writer-31B-F.i1-IQ2_XXS.gguf | Weights | 8.7 GB | 2bcd171a6fd7 |
| Gemma4-Writer-31B-F.i1-IQ3_M.gguf | Weights | 14.4 GB | 1ef973bc0e66 |
| Gemma4-Writer-31B-F.i1-IQ3_XXS.gguf | Weights | 12.1 GB | 13552f2ad786 |
| Gemma4-Writer-31B-F.i1-IQ4_XS.gguf | Weights | 16.7 GB | bbdf843bff7f |
| Gemma4-Writer-31B-F.i1-Q2_K.gguf | Weights | 11.9 GB | ab548507f508 |
| Gemma4-Writer-31B-F.i1-Q2_K_S.gguf | Weights | 11.0 GB | dbe38cb97a18 |
| Gemma4-Writer-31B-F.i1-Q3_K_L.gguf | Weights | 16.6 GB | 448d3600c396 |
| Gemma4-Writer-31B-F.i1-Q3_K_M.gguf | Weights | 15.3 GB | e0c90b72fcba |
| Gemma4-Writer-31B-F.i1-Q3_K_S.gguf | Weights | 13.8 GB | 15d3dbd8a36c |
| Gemma4-Writer-31B-F.i1-Q4_0.gguf | Weights | 17.7 GB | 590288f5fe64 |
| Gemma4-Writer-31B-F.i1-Q4_K_M.gguf | Weights | 18.7 GB | 48b4771b9515 |
| Gemma4-Writer-31B-F.i1-Q4_K_S.gguf | Weights | 17.8 GB | 84d67139c700 |
| Gemma4-Writer-31B-F.i1-Q5_K_M.gguf | Weights | 21.8 GB | 07aa09fb154b |
| Gemma4-Writer-31B-F.i1-Q5_K_S.gguf | Weights | 21.3 GB | 1b850f3606cc |
| Gemma4-Writer-31B-F.i1-Q6_K.gguf | Weights | 25.2 GB | 6c946e642dae |
| Gemma4-Writer-31B-F.imatrix.gguf | Weights | 13.8 MB | 1ef57c48d7d3 |
| README.md | Documentation | 5.2 KB | — |
| .gitattributes | Repository | 3.0 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 288.5 GB
Released by Team Mradermacher through its official repository on Hugging Face.
Built From
- Derived from ConicCat/Gemma4-Writer-31B-F
- Quantized from ConicCat/Gemma4-Writer-31B-F
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 288.5 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.