Open-weight model
XORTRON.CriminalComputing.larger-i1-GGUF
by Team Mradermacher mradermacher/XORTRON.CriminalComputing.larger-i1-GGUF
weighted/imatrix quants of https://huggingface.co/gdorane01/XORTRON.CriminalComputing.larger For a convenient overview and download list, visit our model page for this model.
Model Card
By Team Mradermacher, published under wtfpl, revision b03c1650a0ca.
weighted/imatrix quants of https://huggingface.co/gdorane01/XORTRON.CriminalComputing.larger For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/XORTRON.CriminalComputing.larger-GGUF If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the matter…
Read Team Mradermacher's full model card
About
weighted/imatrix quants of https://huggingface.co/gdorane01/XORTRON.CriminalComputing.larger
For a convenient overview and download list, visit our model page for this model.
static quants are available at https://huggingface.co/mradermacher/XORTRON.CriminalComputing.larger-GGUF
Usage
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | imatrix | 0.1 | imatrix file (for creating your own quants) |
| GGUF | i1-IQ1_M | 28.5 | mostly desperate |
| GGUF | i1-IQ2_XXS | 32.5 | |
| GGUF | i1-Q2_K_S | 41.7 | very low quality |
| GGUF | i1-IQ2_M | 41.7 | |
| GGUF | i1-Q2_K | 45.3 | IQ3_XXS probably better |
| GGUF | i1-IQ3_XXS | 47.1 | lower quality |
| GGUF | i1-Q3_K_S | 52.9 | IQ3_XS probably better |
| GGUF | i1-IQ3_M | 55.4 | |
| GGUF | i1-Q3_K_M | 59.2 | IQ3_S probably better |
| GGUF | i1-Q3_K_L | 64.7 | IQ3_M probably better |
| GGUF | i1-IQ4_XS | 65.5 | |
| GGUF | i1-Q4_K_S | 69.7 | optimal size/speed/quality |
| GGUF | i1-Q4_K_M | 73.3 | fast, recommended |
| PART 1 PART 2 PART 3 | i1-Q6_K | 100.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.
Thanks
I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
Identity and Version
- Repository
- mradermacher/XORTRON.CriminalComputing.larger-i1-GGUF
- Publisher
- Team Mradermacher
- Task
- Not stated by the source
- Modality
- Other
- Library
- transformers
- Parameters
- Not stated by the source
- Languages
- en, fr, de, es, it, pt, zh, ja
- Revision
- b03c1650a0caccc6acca2c88953be5204c177986
- First published
- 2026-09-18
- Last updated
- 2026-09-18
Files and Weights
20 files, 813.0 GB in total. The weights are 15 files totalling 712.4 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| XORTRON.CriminalComputing.larger.i1-IQ1_M.gguf | Weights | 28.4 GB | 17f695b85836 |
| XORTRON.CriminalComputing.larger.i1-IQ2_M.gguf | Weights | 41.6 GB | 75a2ce31fadd |
| XORTRON.CriminalComputing.larger.i1-IQ2_XS.gguf | Weights | 36.1 GB | 3da4c091928a |
| XORTRON.CriminalComputing.larger.i1-IQ2_XXS.gguf | Weights | 32.4 GB | eb84cf9f3a56 |
| XORTRON.CriminalComputing.larger.i1-IQ3_M.gguf | Weights | 55.3 GB | 43d8787a84cd |
| XORTRON.CriminalComputing.larger.i1-IQ3_XXS.gguf | Weights | 47.0 GB | 0c06fe2e456c |
| XORTRON.CriminalComputing.larger.i1-IQ4_XS.gguf | Weights | 65.4 GB | a22485510183 |
| XORTRON.CriminalComputing.larger.i1-Q2_K.gguf | Weights | 45.2 GB | dfb331fc047f |
| XORTRON.CriminalComputing.larger.i1-Q2_K_S.gguf | Weights | 41.6 GB | e07d5706422a |
| XORTRON.CriminalComputing.larger.i1-Q3_K_L.gguf | Weights | 64.6 GB | 4b5242de4134 |
| XORTRON.CriminalComputing.larger.i1-Q3_K_M.gguf | Weights | 59.1 GB | b2dc8e7cbf76 |
| XORTRON.CriminalComputing.larger.i1-Q3_K_S.gguf | Weights | 52.8 GB | 6227ac2646cf |
| XORTRON.CriminalComputing.larger.i1-Q4_K_M.gguf | Weights | 73.2 GB | 8ba73f77f479 |
| XORTRON.CriminalComputing.larger.i1-Q4_K_S.gguf | Weights | 69.6 GB | 0fd867d83ac6 |
| XORTRON.CriminalComputing.larger.imatrix.gguf | Weights | 36.1 MB | 90e8e3fc555a |
| README.md | Documentation | 5.5 KB | — |
| XORTRON.CriminalComputing.larger.i1-Q6_K.gguf.part1of3 | Other | 34.4 GB | 0ee808caa73f |
| XORTRON.CriminalComputing.larger.i1-Q6_K.gguf.part2of3 | Other | 34.4 GB | 3b0d45766830 |
| XORTRON.CriminalComputing.larger.i1-Q6_K.gguf.part3of3 | Other | 31.9 GB | b27f7bbd57d7 |
| .gitattributes | Repository | 3.0 KB | — |
License and Download
- License
- wtfpl
- Access
- Open weights, no gate
- Download size
- 712.4 GB
Released by Team Mradermacher through its official repository on Hugging Face.
Built From
- Derived from gdorane01/XORTRON.CriminalComputing.larger
- Quantized from gdorane01/XORTRON.CriminalComputing.larger
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 712.4 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About XORTRON.CriminalComputing.larger-i1-GGUF
What license is XORTRON.CriminalComputing.larger-i1-GGUF released under?
wtfpl, as its publisher declares it. Read the license text before commercial use.