Orythos-9B-i1-GGUF is an open-weight model from Team Mradermacher. Its published files total 68.2 GB.
weighted/imatrix quants of https://huggingface.co/CloudGoat/Orythos-9B For a convenient overview and download list, visit our model page for this model.
Model Card
weighted/imatrix quants of https://huggingface.co/CloudGoat/Orythos-9B For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Orythos-9B-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the matter…
Excerpt from the card by Team Mradermacher.
Identity and Version
- Repository
- mradermacher/Orythos-9B-i1-GGUF
- Publisher
- Team Mradermacher
- Task
- Not stated by the source
- Modality
- Other
- Library
- transformers
- Parameters
- Not stated by the source
- Languages
- en
- Revision
- 999f9c18eb469b6d1fab370e8fc0badb4de13796
- First published
- 2026-09-27
- Last updated
- 2026-09-27
Files and Weights
18 files, 68.2 GB in total. The weights are 16 files totalling 68.2 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| Orythos-9B.i1-IQ1_M.gguf | Weights | 2.9 GB | 6cccefbf57ad |
| Orythos-9B.i1-IQ2_M.gguf | Weights | 3.6 GB | f6514c90d024 |
| Orythos-9B.i1-IQ2_XXS.gguf | Weights | 3.1 GB | 7f3de38b2a41 |
| Orythos-9B.i1-IQ3_M.gguf | Weights | 4.4 GB | 768c2eeb3992 |
| Orythos-9B.i1-IQ3_XXS.gguf | Weights | 3.9 GB | 60247b886832 |
| Orythos-9B.i1-IQ4_NL.gguf | Weights | 5.4 GB | 709462bea269 |
| Orythos-9B.i1-IQ4_XS.gguf | Weights | 5.2 GB | 1d0bad98a413 |
| Orythos-9B.i1-Q2_K.gguf | Weights | 3.8 GB | 0706a7ddcc6c |
| Orythos-9B.i1-Q2_K_S.gguf | Weights | 3.7 GB | d2713d892064 |
| Orythos-9B.i1-Q3_K_L.gguf | Weights | 4.9 GB | d1c29bdf404d |
| Orythos-9B.i1-Q3_K_M.gguf | Weights | 4.6 GB | aaeb6803ed80 |
| Orythos-9B.i1-Q3_K_S.gguf | Weights | 4.3 GB | 995fdbf8ebf9 |
| Orythos-9B.i1-Q4_K_M.gguf | Weights | 5.6 GB | 636e50b4b039 |
| Orythos-9B.i1-Q4_K_S.gguf | Weights | 5.4 GB | 45b86a21ba61 |
| Orythos-9B.i1-Q6_K.gguf | Weights | 7.4 GB | 2ca123a5ac95 |
| Orythos-9B.imatrix.gguf | Weights | 5.2 MB | 4184c1723ed6 |
| README.md | Documentation | 4.0 KB | — |
| .gitattributes | Repository | 2.5 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 68.2 GB
Released by Team Mradermacher through its official repository on Hugging Face.
Built From
- Derived from CloudGoat/Orythos-9B
- Quantized from CloudGoat/Orythos-9B
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 68.2 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.