Open-weight model
Qwen3.8-27b-Terse-Coder-GGUF
by Jad El-Khatib Shockem/Qwen3.8-27b-Terse-Coder-GGUF
Qwen3.8-27b-Terse-Coder-GGUF is an open-weight model from Jad El-Khatib, released under Apache License 2.0. Its published files total 106.2 GB. It draws 225 downloads a month.
GGUF builds of (round 8, final) — a fine-tune of Qwen/Qwen3.8-27B with ~1/10 the chain-of-thought reasoning tokens on coding tasks and correctness preserved.
Model Card
By Jad El-Khatib, published under apache-2.0, revision 8982f5cf3222.
GGUF builds of (round 8, final) — a fine-tune of Qwen/Qwen3.8-27B with ~1/10 the chain-of-thought reasoning tokens on coding tasks and correctness preserved. Quant spread (Q4KM smoke-tested on llama.cpp — correct code generation, reasoning parsing, ~22 tok/s on 2× RTX 5060 Ti): The MTP draft layer is included in the GGUF but unused by llama.cpp (harmless warnings about unused blk.N.nextn. tensors are expected); speculative decoding is a vLLM-side feature. Behavior/quality reference: HE+ 91.5 / MBPP+ 79.4 / GSM8K 98.5 / GPQA 79.8 on the source repo (vLLM measurements; GGUF Q4KM verified by smoke test only — validate quality on your own hardware before relying on it). vLLM deployment build at…
Read Jad El-Khatib's full model card
GGUF builds of Shockem/Qwen3.8-27b-Terse-Coder (round 8, final) — a fine-tune of Qwen/Qwen3.8-27B with ~1/10 the chain-of-thought reasoning tokens on coding tasks and correctness preserved.
Quant spread (Q4_K_M smoke-tested on llama.cpp — correct code generation, reasoning parsing, ~22 tok/s on 2× RTX 5060 Ti):
| File | Size | Notes |
|---|---|---|
Qwen3.8-27b-Terse-Coder.Q4_K_M.gguf |
~16.8G | Balanced quality/speed — the default pick |
Qwen3.8-27b-Terse-Coder.Q5_K_M.gguf |
~19.5G | |
Qwen3.8-27b-Terse-Coder.Q6_K.gguf |
~22.4G | |
Qwen3.8-27b-Terse-Coder.Q8_0.gguf |
~29.0G | Near-lossless |
Qwen3.8-27b-Terse-Coder.mmproj-f16.gguf |
~0.9G | Vision projector (required for images) |
Qwen3.8-27b-Terse-Coder.mmproj-Q8_0.gguf |
~0.6G | Vision projector, quantized |
Usage (llama.cpp server):
llama-server -m Qwen3.8-27b-Terse-Coder.Q4_K_M.gguf \
--mmproj Qwen3.8-27b-Terse-Coder.mmproj-f16.gguf \
-ngl 99 -c 32768
The MTP draft layer is included in the GGUF but unused by llama.cpp
(harmless warnings about unused blk.N.nextn.* tensors are expected);
speculative decoding is a vLLM-side feature. Behavior/quality reference:
HE+ 91.5 / MBPP+ 79.4 / GSM8K 98.5 / GPQA 79.8 on the source repo (vLLM
measurements; GGUF Q4_K_M verified by smoke test only — validate quality on
your own hardware before relying on it).
Source and provenance: fp16 merge at Shockem/Qwen3.8-27b-Terse-Coder; vLLM deployment build at Shockem/Qwen3.8-27b-Terse-Coder-NVFP4; adapter lineage at Shockem/Qwen3.8-27b-Terse-Coder-LoRA. Licensed Apache 2.0, same as the base model (© Qwen Team, Alibaba Cloud).
Identity and Version
- Repository
- Shockem/Qwen3.8-27b-Terse-Coder-GGUF
- Publisher
- Jad El-Khatib
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 8982f5cf322203ca7779ee2f4f765fb06919059b
- First published
- 2026-09-19
- Last updated
- 2026-09-23
Files and Weights
9 files, 106.2 GB in total. The weights are 7 files totalling 106.2 GB in gguf.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| Qwen3.8-27b-Terse-Coder-q4_k_m.gguf | Weights | 16.8 GB | e288d09e29db |
| Qwen3.8-27b-Terse-Coder-q8_0.gguf | Weights | 29.0 GB | 358dfb4d66d6 |
| Qwen3.8-27b-Terse-Coder.Q4_K_M.gguf | Weights | 16.8 GB | ecd44d60f737 |
| Qwen3.8-27b-Terse-Coder.Q5_K_M.gguf | Weights | 19.5 GB | 6e01c326a4c5 |
| Qwen3.8-27b-Terse-Coder.Q6_K.gguf | Weights | 22.4 GB | 3164a8d8cc7f |
| Qwen3.8-27b-Terse-Coder.mmproj-Q8_0.gguf | Weights | 629.2 MB | b92704ad5135 |
| Qwen3.8-27b-Terse-Coder.mmproj-f16.gguf | Weights | 927.6 MB | 6799c5902f0d |
| README.md | Documentation | 2.1 KB | — |
| .gitattributes | Repository | 2.0 KB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 106.2 GB
Released by Jad El-Khatib through its official repository on Hugging Face. Read the license.
Built From
- Derived from Shockem/Qwen3.8-27b-Terse-Coder
- Quantized from Shockem/Qwen3.8-27b-Terse-Coder
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 106.2 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About Qwen3.8-27b-Terse-Coder-GGUF
Can I use Qwen3.8-27b-Terse-Coder-GGUF commercially?
Yes. Qwen3.8-27b-Terse-Coder-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.