Holo4-27B-i1-GGUF is an open-weight model from Team Mradermacher, released under Creative Commons Attribution-NonCommercial 4.0. Its published files total 165.5 GB.
weighted/imatrix quants of https://huggingface.co/Hcompany/Holo4-27B For a convenient overview and download list, visit our model page for this model.
Model Card
weighted/imatrix quants of https://huggingface.co/Hcompany/Holo4-27B For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Holo4-27B-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the matter…
Excerpt from the card by Team Mradermacher, licensed cc-by-nc-4.0.
Identity and Version
- Repository
- mradermacher/Holo4-27B-i1-GGUF
- Publisher
- Team Mradermacher
- Task
- Not stated by the source
- Modality
- Other
- Library
- transformers
- Parameters
- Not stated by the source
- Languages
- en
- Revision
- 68c8cef1f50c1251cd27e920475eea45913af2f8
- First published
- 2026-09-29
- Last updated
- 2026-09-29
Files and Weights
16 files, 165.5 GB in total. The weights are 14 files totalling 165.5 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| Holo4-27B.i1-IQ1_M.gguf | Weights | 7.6 GB | 89441208076f |
| Holo4-27B.i1-IQ2_M.gguf | Weights | 10.0 GB | 4761f09b1063 |
| Holo4-27B.i1-IQ2_XXS.gguf | Weights | 8.4 GB | c9d8c8b92925 |
| Holo4-27B.i1-IQ3_M.gguf | Weights | 12.6 GB | c08c1df7fb90 |
| Holo4-27B.i1-IQ3_XXS.gguf | Weights | 11.2 GB | 4768f12a031a |
| Holo4-27B.i1-IQ4_XS.gguf | Weights | 15.1 GB | 56191b8cb4de |
| Holo4-27B.i1-Q2_K.gguf | Weights | 10.7 GB | 25f964fbcc1e |
| Holo4-27B.i1-Q2_K_S.gguf | Weights | 10.2 GB | e40e31d1b32e |
| Holo4-27B.i1-Q3_K_M.gguf | Weights | 13.3 GB | 156d214e1608 |
| Holo4-27B.i1-Q3_K_S.gguf | Weights | 12.1 GB | 5a10844f2412 |
| Holo4-27B.i1-Q4_K_M.gguf | Weights | 16.5 GB | f4fbe41df72c |
| Holo4-27B.i1-Q4_K_S.gguf | Weights | 15.6 GB | 1bf94ae6afb4 |
| Holo4-27B.i1-Q6_K.gguf | Weights | 22.1 GB | 230bdb4b168a |
| Holo4-27B.imatrix.gguf | Weights | 13.6 MB | 8dc1a3d4c1c4 |
| README.md | Documentation | 3.5 KB | — |
| .gitattributes | Repository | 2.4 KB | — |
License and Download
- License
- cc-by-nc-4.0
- Access
- Open weights, no gate
- Download size
- 165.5 GB
Released by Team Mradermacher through its official repository on Hugging Face. Read the license.
Built From
- Derived from Hcompany/Holo4-27B
- Quantized from Hcompany/Holo4-27B
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 165.5 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About Holo4-27B-i1-GGUF
Can I use Holo4-27B-i1-GGUF commercially?
Not without separate permission. Holo4-27B-i1-GGUF is released under Creative Commons Attribution-NonCommercial 4.0. CC BY-NC 4.0 permits sharing and adapting with credit for non-commercial purposes only. Commercial use needs separate permission from the rights holder.