ThinCtx-Qwen3.5-4B-GGUF is an open-weight model from Team Mradermacher, released under other. Its published files total 38.9 GB.
static quants of https://huggingface.co/thinletter/ThinCtx-Qwen3.5-4B For a convenient overview and download list, visit our model page for this model.
Model Card
static quants of https://huggingface.co/thinletter/ThinCtx-Qwen3.5-4B For a convenient overview and download list, visit our model page for this model. weighted/imatrix quants are available at https://huggingface.co/mradermacher/ThinCtx-Qwen3.5-4B-i1-GGUF If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 See…
Excerpt from the card by Team Mradermacher, licensed other.
Identity and Version
- Repository
- mradermacher/ThinCtx-Qwen3.5-4B-GGUF
- Publisher
- Team Mradermacher
- Task
- Not stated by the source
- Modality
- Other
- Library
- transformers
- Parameters
- Not stated by the source
- Languages
- en, cs, de
- Revision
- 2c5fe1afcb90bfe3773847567f19bdb2df2015e8
- First published
- 2026-10-14
- Last updated
- 2026-10-14
Files and Weights
14 files, 38.9 GB in total. The weights are 12 files totalling 38.9 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| ThinCtx-Qwen3.5-4B.IQ4_XS.gguf | Weights | 2.5 GB | 512e59e0cf15 |
| ThinCtx-Qwen3.5-4B.Q2_K.gguf | Weights | 1.9 GB | bfa9c4ec6d77 |
| ThinCtx-Qwen3.5-4B.Q3_K_L.gguf | Weights | 2.4 GB | f2c823026516 |
| ThinCtx-Qwen3.5-4B.Q3_K_M.gguf | Weights | 2.3 GB | 2dfd654f72fc |
| ThinCtx-Qwen3.5-4B.Q3_K_S.gguf | Weights | 2.1 GB | 71b9d40e70e6 |
| ThinCtx-Qwen3.5-4B.Q4_K_M.gguf | Weights | 2.7 GB | 398e855bcef5 |
| ThinCtx-Qwen3.5-4B.Q4_K_S.gguf | Weights | 2.6 GB | d3636c9b660d |
| ThinCtx-Qwen3.5-4B.Q5_K_M.gguf | Weights | 3.1 GB | 52b644a4dde6 |
| ThinCtx-Qwen3.5-4B.Q5_K_S.gguf | Weights | 3.0 GB | 6b5188f0e74f |
| ThinCtx-Qwen3.5-4B.Q6_K.gguf | Weights | 3.5 GB | 84ee271f8be2 |
| ThinCtx-Qwen3.5-4B.Q8_0.gguf | Weights | 4.5 GB | b7187f616068 |
| ThinCtx-Qwen3.5-4B.f16.gguf | Weights | 8.4 GB | 919a31366f56 |
| README.md | Documentation | 4.2 KB | — |
| .gitattributes | Repository | 2.3 KB | — |
License and Download
- License
- other
- Access
- Open weights, no gate
- Download size
- 38.9 GB
Released by Team Mradermacher through its official repository on Hugging Face.
Built From
- Derived from thinletter/ThinCtx-Qwen3.5-4B
- Quantized from thinletter/ThinCtx-Qwen3.5-4B
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 38.9 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About ThinCtx-Qwen3.5-4B-GGUF
What license is ThinCtx-Qwen3.5-4B-GGUF released under?
other, as its publisher declares it. Read the license text before commercial use.