Open-weight model
qwen-coder-3b-agentic-v3-gguf
by James Kutah jkkutah/qwen-coder-3b-agentic-v3-gguf
qwen-coder-3b-agentic-v3-gguf is an open-weight model from James Kutah. It has 32,768-token context. Its published files total 1.9 GB.
This model was finetuned and converted to GGUF format using Unsloth. - Qwen2.5-Coder-3B-Instruct.Q4KM.gguf An Ollama Modelfile is included for easy deployment. This was trained 2x faster with Unsloth
Model Card
This model was finetuned and converted to GGUF format using Unsloth. - Qwen2.5-Coder-3B-Instruct.Q4KM.gguf An Ollama Modelfile is included for easy deployment. This was trained 2x faster with Unsloth
Excerpt from the card by James Kutah.
Configuration
- Architecture
- Qwen2ForCausalLM
- Context length (tokens)
- 32,768
- Layers
- 36
- Hidden size
- 2,048
- Feed-forward size
- 11,008
- Attention heads
- 16
- Key/value heads
- 2
- Vocabulary size
- 151,936
- Stored precision
- bfloat16
- Model type
- qwen2
Identity and Version
- Repository
- jkkutah/qwen-coder-3b-agentic-v3-gguf
- Publisher
- James Kutah
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- acde5b5ddbb8cbc69d9a411e3e0521530fd18f2b
- First published
- 2026-10-08
- Last updated
- 2026-10-08
Files and Weights
5 files, 1.9 GB in total. The weights are 1 file totalling 1.9 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| Qwen2.5-Coder-3B-Instruct.Q4_K_M.gguf | Weights | 1.9 GB | f447b2011508 |
| config.json | Configuration | 1.8 KB | — |
| README.md | Documentation | 768 B | — |
| Modelfile | Other | 1.8 KB | — |
| .gitattributes | Repository | 1.6 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 1.9 GB
Released by James Kutah through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 1.9 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About qwen-coder-3b-agentic-v3-gguf
What is qwen-coder-3b-agentic-v3-gguf's context length?
32,768 tokens, from the maximum position embeddings in its published configuration.