Open-weight model
Qwen2.5-7B-OBLITERATED-i1-GGUF
by Team Mradermacher mradermacher/Qwen2.5-7B-OBLITERATED-i1-GGUF
Qwen2.5-7B-OBLITERATED-i1-GGUF is an open-weight model from Team Mradermacher. Its published files total 77.3 GB.
weighted/imatrix quants of https://huggingface.co/BabarAzaa/Qwen2.5-7B-OBLITERATED For a convenient overview and download list, visit our model page for this model.
Model Card
weighted/imatrix quants of https://huggingface.co/BabarAzaa/Qwen2.5-7B-OBLITERATED For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Qwen2.5-7B-OBLITERATED-GGUF If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9…
Excerpt from the card by Team Mradermacher.
Identity and Version
- Repository
- mradermacher/Qwen2.5-7B-OBLITERATED-i1-GGUF
- Publisher
- Team Mradermacher
- Task
- Not stated by the source
- Modality
- Other
- Library
- transformers
- Parameters
- Not stated by the source
- Languages
- en
- Revision
- 7ee83426d404b96ffa3f51f28ddca552cd40ca9f
- First published
- 2026-10-01
- Last updated
- 2026-10-01
Files and Weights
24 files, 77.3 GB in total. The weights are 22 files totalling 77.3 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| Qwen2.5-7B-OBLITERATED.i1-IQ1_M.gguf | Weights | 2.0 GB | 6fc2d36e9693 |
| Qwen2.5-7B-OBLITERATED.i1-IQ1_S.gguf | Weights | 1.9 GB | 160436eaf2c7 |
| Qwen2.5-7B-OBLITERATED.i1-IQ2_M.gguf | Weights | 2.8 GB | c5c92febdc47 |
| Qwen2.5-7B-OBLITERATED.i1-IQ2_S.gguf | Weights | 2.6 GB | 7183d431abc5 |
| Qwen2.5-7B-OBLITERATED.i1-IQ2_XS.gguf | Weights | 2.5 GB | 501293a65dbb |
| Qwen2.5-7B-OBLITERATED.i1-IQ2_XXS.gguf | Weights | 2.3 GB | 603400a2a07e |
| Qwen2.5-7B-OBLITERATED.i1-IQ3_M.gguf | Weights | 3.6 GB | d1fc97e32544 |
| Qwen2.5-7B-OBLITERATED.i1-IQ3_XXS.gguf | Weights | 3.1 GB | 41916c0d9588 |
| Qwen2.5-7B-OBLITERATED.i1-IQ4_NL.gguf | Weights | 4.4 GB | 1e49c0f92d6a |
| Qwen2.5-7B-OBLITERATED.i1-IQ4_XS.gguf | Weights | 4.2 GB | 01cad61d2229 |
| Qwen2.5-7B-OBLITERATED.i1-Q2_K.gguf | Weights | 3.0 GB | 5e359b585905 |
| Qwen2.5-7B-OBLITERATED.i1-Q2_K_S.gguf | Weights | 2.8 GB | e66b4c6a5911 |
| Qwen2.5-7B-OBLITERATED.i1-Q3_K_L.gguf | Weights | 4.1 GB | 2b5fe9128959 |
| Qwen2.5-7B-OBLITERATED.i1-Q3_K_M.gguf | Weights | 3.8 GB | 8b15214a0951 |
| Qwen2.5-7B-OBLITERATED.i1-Q3_K_S.gguf | Weights | 3.5 GB | 16f49bb9afb8 |
| Qwen2.5-7B-OBLITERATED.i1-Q4_0.gguf | Weights | 4.4 GB | 2e941bb16373 |
| Qwen2.5-7B-OBLITERATED.i1-Q4_K_M.gguf | Weights | 4.7 GB | 57768a1aa77c |
| Qwen2.5-7B-OBLITERATED.i1-Q4_K_S.gguf | Weights | 4.5 GB | ea2552bf3a73 |
| Qwen2.5-7B-OBLITERATED.i1-Q5_K_M.gguf | Weights | 5.4 GB | 4c46b9f5922b |
| Qwen2.5-7B-OBLITERATED.i1-Q5_K_S.gguf | Weights | 5.3 GB | 0f8fc8cd5dff |
| Qwen2.5-7B-OBLITERATED.i1-Q6_K.gguf | Weights | 6.3 GB | 6598c1678640 |
| Qwen2.5-7B-OBLITERATED.imatrix.gguf | Weights | 4.6 MB | 50c118f855e7 |
| README.md | Documentation | 5.9 KB | — |
| .gitattributes | Repository | 3.1 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 77.3 GB
Released by Team Mradermacher through its official repository on Hugging Face.
Built From
- Derived from BabarAzaa/Qwen2.5-7B-OBLITERATED
- Quantized from BabarAzaa/Qwen2.5-7B-OBLITERATED
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 77.3 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.