Open-weight model
WaifuGemma4-26b-a4b-v1-i1-GGUF
by Team Mradermacher mradermacher/WaifuGemma4-26b-a4b-v1-i1-GGUF
WaifuGemma4-26b-a4b-v1-i1-GGUF is an open-weight model from Team Mradermacher, released under Gemma Terms of Use. Its published files total 272.7 GB.
weighted/imatrix quants of https://huggingface.co/hiwaifu-research/WaifuGemma4-26b-a4b-v1 For a convenient overview and download list, visit our model page for this model.
Model Card
weighted/imatrix quants of https://huggingface.co/hiwaifu-research/WaifuGemma4-26b-a4b-v1 For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/WaifuGemma4-26b-a4b-v1-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's…
Excerpt from the card by Team Mradermacher, licensed gemma.
Identity and Version
- Repository
- mradermacher/WaifuGemma4-26b-a4b-v1-i1-GGUF
- Publisher
- Team Mradermacher
- Task
- Not stated by the source
- Modality
- Other
- Library
- transformers
- Parameters
- Not stated by the source
- Languages
- en, es, ru, pt, id, ar, th, fr
- Revision
- 9f3529bde2822c944f292191f377e796d79ec0f3
- First published
- 2026-09-18
- Last updated
- 2026-09-19
Files and Weights
24 files, 272.7 GB in total. The weights are 22 files totalling 272.7 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| WaifuGemma4-26b-a4b-v1.i1-IQ1_M.gguf | Weights | 8.7 GB | 42a482f0be9f |
| WaifuGemma4-26b-a4b-v1.i1-IQ1_S.gguf | Weights | 8.3 GB | 2f668ff22e3a |
| WaifuGemma4-26b-a4b-v1.i1-IQ2_M.gguf | Weights | 10.4 GB | ca80e99aeb8b |
| WaifuGemma4-26b-a4b-v1.i1-IQ2_S.gguf | Weights | 9.9 GB | 6003ac5bb973 |
| WaifuGemma4-26b-a4b-v1.i1-IQ2_XS.gguf | Weights | 9.8 GB | 6c101e601a7a |
| WaifuGemma4-26b-a4b-v1.i1-IQ2_XXS.gguf | Weights | 9.3 GB | c7334b567fc3 |
| WaifuGemma4-26b-a4b-v1.i1-IQ3_M.gguf | Weights | 12.4 GB | ce6b5c0065d3 |
| WaifuGemma4-26b-a4b-v1.i1-IQ3_XS.gguf | Weights | 11.6 GB | a994a14cb637 |
| WaifuGemma4-26b-a4b-v1.i1-IQ3_XXS.gguf | Weights | 11.3 GB | ab8da67abd21 |
| WaifuGemma4-26b-a4b-v1.i1-IQ4_XS.gguf | Weights | 13.9 GB | 81aa70cc6f7d |
| WaifuGemma4-26b-a4b-v1.i1-Q2_K.gguf | Weights | 10.6 GB | 0d89314728c0 |
| WaifuGemma4-26b-a4b-v1.i1-Q2_K_S.gguf | Weights | 10.6 GB | cd2205f47052 |
| WaifuGemma4-26b-a4b-v1.i1-Q3_K_L.gguf | Weights | 13.8 GB | 9ce378323fc9 |
| WaifuGemma4-26b-a4b-v1.i1-Q3_K_M.gguf | Weights | 13.3 GB | af6cb58c7caa |
| WaifuGemma4-26b-a4b-v1.i1-Q3_K_S.gguf | Weights | 12.2 GB | b89e84d4a7ef |
| WaifuGemma4-26b-a4b-v1.i1-Q4_0.gguf | Weights | 14.5 GB | 2869286d98cb |
| WaifuGemma4-26b-a4b-v1.i1-Q4_K_M.gguf | Weights | 16.8 GB | ae20774c4250 |
| WaifuGemma4-26b-a4b-v1.i1-Q4_K_S.gguf | Weights | 15.5 GB | 79792d910225 |
| WaifuGemma4-26b-a4b-v1.i1-Q5_K_M.gguf | Weights | 19.1 GB | d903693a7ece |
| WaifuGemma4-26b-a4b-v1.i1-Q5_K_S.gguf | Weights | 18.0 GB | 7233edde2bbf |
| WaifuGemma4-26b-a4b-v1.i1-Q6_K.gguf | Weights | 22.6 GB | 528daa97d6a5 |
| WaifuGemma4-26b-a4b-v1.imatrix.gguf | Weights | 56.9 MB | 7a2396fb55c4 |
| README.md | Documentation | 6.1 KB | — |
| .gitattributes | Repository | 3.1 KB | — |
License and Download
- License
- gemma
- Access
- Open weights, no gate
- Download size
- 272.7 GB
Released by Team Mradermacher through its official repository on Hugging Face.
Built From
- Derived from hiwaifu-research/WaifuGemma4-26b-a4b-v1
- Quantized from hiwaifu-research/WaifuGemma4-26b-a4b-v1
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 272.7 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About WaifuGemma4-26b-a4b-v1-i1-GGUF
Can I use WaifuGemma4-26b-a4b-v1-i1-GGUF commercially?
Yes, with conditions. WaifuGemma4-26b-a4b-v1-i1-GGUF is released under Gemma Terms of Use. Gemma models are released under Google's Gemma Terms of Use, which permit commercial use and redistribution subject to the Gemma Prohibited Use Policy, whose restrictions must be passed on to anyone the model is distributed to.