Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Qwen3.8-27B-BaseQuant-V1

by Base Compute basecompute/Qwen3.8-27B-BaseQuant-V1

Qwen3.8-27B-BaseQuant-V1 is an open-weight model for text generation from Base Compute, released under Apache License 2.0. Its published files total 100.7 GB. It draws 2 downloads a month.

Quantized builds of Qwen/Qwen3.8-27B in three sizes. On held-out text, each one is closer to the BF16 model than the unsloth dynamic quant of the same size. Each GGUF is no larger than its unsloth counterpart. The Small bundle needs baseRT 0.4.0 or later.

Parameters—
Context—
Weights48.2 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads2

Model Card

By Base Compute, published under apache-2.0, revision 7cacbceec2f9.

Quantized builds of Qwen/Qwen3.8-27B in three sizes. On held-out text, each one is closer to the BF16 model than the unsloth dynamic quant of the same size. Each GGUF is no larger than its unsloth counterpart. The Small bundle needs baseRT 0.4.0 or later. KL divergence of each quant's next-token distribution from the BF16 model, ours beside unsloth's quant of the same size, measured in llama.cpp. Lower is closer to BF16. The percentage over each pair is our change against unsloth. On text that was not used to build these files, all three are 17–34% closer to BF16 than unsloth's quant of the same size. Each cell: unsloth KL / BaseQuant KL (change). Bold marks the lower KL. The prompts come…

Read Base Compute's full model card

Quantized builds of Qwen/Qwen3.8-27B in three sizes. On held-out text, each one is closer to the BF16 model than the unsloth dynamic quant of the same size.

Size GGUF (llama.cpp) baseRT bundle Same size as
Small Qwen3.8-27B-BaseQuant-V1-Small.gguf (10.93 GB) Qwen3.8-27B-BaseQuant-V1-Small.base unsloth UD-IQ3_XXS (10.93 GB)
Medium Qwen3.8-27B-BaseQuant-V1-Medium.gguf (16.41 GB) Qwen3.8-27B-BaseQuant-V1-Medium.base unsloth UD-Q4_K_M (16.46 GB)
Large Qwen3.8-27B-BaseQuant-V1-Large.gguf (20.82 GB) Qwen3.8-27B-BaseQuant-V1-Large.base unsloth UD-Q5_K_XL (20.88 GB)

Each GGUF is no larger than its unsloth counterpart. The Small bundle needs baseRT 0.4.0 or later.

Usage

# llama.cpp
llama-server -hf basecompute/Qwen3.8-27B-BaseQuant-V1 -hff Qwen3.8-27B-BaseQuant-V1-Medium.gguf -c 32768 -ngl 99


# SuperFluid
superfluid serve basecompute/Qwen3.8-27B-BaseQuant-V1 --runtime llamacpp --pull-file Qwen3.8-27B-BaseQuant-V1-Medium.gguf

# baseRT
hf download basecompute/Qwen3.8-27B-BaseQuant-V1 Qwen3.8-27B-BaseQuant-V1-Large.base --local-dir .
basert serve ./Qwen3.8-27B-BaseQuant-V1-Large.base

Results

KL divergence of each quant's next-token distribution from the BF16 model, ours beside unsloth's quant of the same size, measured in llama.cpp. Lower is closer to BF16. The percentage over each pair is our change against unsloth.

Held-out text

On text that was not used to build these files, all three are 17–34% closer to BF16 than unsloth's quant of the same size.

Held-out text Small vs UD-IQ3_XXS Medium vs UD-Q4_K_M Large vs UD-Q5_K_XL
Model's own continuations 0.0391 / 0.0308 (-21%) 0.00713 / 0.00555 (-22%) 0.00278 / 0.00200 (-28%)
Written text 0.5288 / 0.4318 (-18%) 0.2081 / 0.1579 (-24%) 0.1080 / 0.0716 (-34%)
Tool-call turns 0.0631 / 0.0526 (-17%) 0.0127 / 0.0099 (-22%) 0.00496 / 0.00354 (-29%)
Tool calls + final answers 0.0631 / 0.0523 (-17%) 0.0112 / 0.0090 (-20%) 0.00432 / 0.00320 (-26%)

Each cell: unsloth KL / BaseQuant KL (change). Bold marks the lower KL.

Public prompts

The prompts come from six public datasets (OpenHands, SWE-agent, Glaive function calling, OpenOrca, Tulu 3, OpenHermes). The BF16 model writes each continuation (thinking on), and both quants are scored along it.

Source Small vs UD-IQ3_XXS Medium vs UD-Q4_K_M Large vs UD-Q5_K_XL
OpenHands 0.1190 / 0.0793 (-33%) 0.0212 / 0.0182 (-14%) 0.00450 / 0.00447 (-1%)
SWE-agent 0.0449 / 0.0330 (-27%) 0.00912 / 0.00708 (-22%) 0.00293 / 0.00241 (-18%)
Glaive function calling 0.0673 / 0.0628 (-7%) 0.0112 / 0.0098 (-13%) 0.00335 / 0.00325 (-3%)
OpenOrca 0.0515 / 0.0431 (-16%) 0.00759 / 0.00624 (-18%) 0.00248 / 0.00231 (-7%)
Tulu 3 0.0470 / 0.0402 (-14%) 0.00730 / 0.00585 (-20%) 0.00238 / 0.00231 (-3%)
OpenHermes 0.0445 / 0.0420 (-6%) 0.00639 / 0.00613 (-4%) 0.00203 / 0.00209 (+3%)
All six 0.0539 / 0.0460 (-15%) 0.00861 / 0.00731 (-15%) 0.00262 / 0.00253 (-3%)

Each cell: unsloth KL / BaseQuant KL (change). Bold marks the lower KL.

Identity and Version

Repository
basecompute/Qwen3.8-27B-BaseQuant-V1
Publisher
Base Compute
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
7cacbceec2f976e626cf5ec4c4c42adbc88f44d5
First published
2026-10-19
Last updated
2026-10-22

Files and Weights

10 files, 100.7 GB in total. The weights are 3 files totalling 48.2 GB in gguf.

Weights3 files · 48.2 GB
Documentation1 file · 3.7 KB
Other5 files · 52.5 GB
Repository1 file · 2.1 KB
Every file
FileTypeSizeSHA-256
Qwen3.8-27B-BaseQuant-V1-Large.ggufWeights20.8 GB 1e78ba5e522f
Qwen3.8-27B-BaseQuant-V1-Medium.ggufWeights16.4 GB 277099522be3
Qwen3.8-27B-BaseQuant-V1-Small.ggufWeights10.9 GB 88b06bfb523e
README.mdDocumentation3.7 KB —
Qwen3.8-27B-BaseQuant-V1-Large.baseOther22.3 GB 2099b96d2f41
Qwen3.8-27B-BaseQuant-V1-Medium.baseOther17.9 GB 32815ca75cd1
Qwen3.8-27B-BaseQuant-V1-Small.baseOther12.4 GB e2fe01e53c6d
heldout_kl.pngOther130.2 KB 89b7cf21fc3f
onpolicy_kl.pngOther147.6 KB 840d13297409
.gitattributesRepository2.1 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
48.2 GB
Download from Base Compute

Released by Base Compute through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published48.2 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.8-27B-BaseQuant-V1

Can I use Qwen3.8-27B-BaseQuant-V1 commercially?

Yes. Qwen3.8-27B-BaseQuant-V1 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers