Open-weight model
qwen3-4b-thinking-2507-16k-GGUF
by Zealatik cg2020/qwen3-4b-thinking-2507-16k-GGUF
qwen3-4b-thinking-2507-16k-GGUF is an open-weight model from Zealatik. It has 262,144-token context. Its published files total 2.5 GB.
This model was finetuned and converted to GGUF format using Unsloth. - qwen3-4b-thinking-2507.Q4KM.gguf An Ollama Modelfile is included for easy deployment. This was trained 2x faster with Unsloth
Model Card
This model was finetuned and converted to GGUF format using Unsloth. - qwen3-4b-thinking-2507.Q4KM.gguf An Ollama Modelfile is included for easy deployment. This was trained 2x faster with Unsloth
Excerpt from the card by Zealatik.
Configuration
- Architecture
- Qwen3ForCausalLM
- Context length (tokens)
- 262,144
- Layers
- 36
- Hidden size
- 2,560
- Feed-forward size
- 9,728
- Attention heads
- 32
- Key/value heads
- 8
- Head dimension
- 128
- Vocabulary size
- 151,936
- Stored precision
- bfloat16
- Model type
- qwen3
Identity and Version
- Repository
- cg2020/qwen3-4b-thinking-2507-16k-GGUF
- Publisher
- Zealatik
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 425c85aa2966c469fe1fad921e81dabb9fd34ab8
- First published
- 2026-09-25
- Last updated
- 2026-09-25
Files and Weights
5 files, 2.5 GB in total. The weights are 1 file totalling 2.5 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| qwen3-4b-thinking-2507.Q4_K_M.gguf | Weights | 2.5 GB | a83481bc458d |
| config.json | Configuration | 1.8 KB | — |
| README.md | Documentation | 769 B | — |
| Modelfile | Other | 1.6 KB | — |
| .gitattributes | Repository | 1.6 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 2.5 GB
Released by Zealatik through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 2.5 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About qwen3-4b-thinking-2507-16k-GGUF
What is qwen3-4b-thinking-2507-16k-GGUF's context length?
262,144 tokens, from the maximum position embeddings in its published configuration.