SAVRN
Search Contact SAVRN

Open-weight model

Qwen3.8-27B-GGUF

by Unsloth AI unsloth/Qwen3.8-27B-GGUF

Analysis of best Qwen3.8 GGUF providers. Unsloth Dynamic v3.0 delivers >10% top-1% better accuracy at the same size compared to every other provider.

Parameters
Context262,144
Weights472.1 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads7.6M

Model Card

By Unsloth AI, published under apache-2.0, revision 4ca720788d1e.

Analysis of best Qwen3.8 GGUF providers. Unsloth Dynamic v3.0 delivers >10% top-1% better accuracy at the same size compared to every other provider. Read more Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date. Built on the architectural foundation of Qwen3.5, Qwen3.8 delivers substantial gains across coding, professional work, research, and long-horizon agentic tasks. Qwen3.8-27B brings these advances to a compact, deployment-friendly dense model: a native vision-language model that understands images and videos, with flexible thinking control, designed to…

Read Unsloth AI's full model card

Read our How to Run Qwen3.8-27B Guide!

Unsloth Dynamic 3.0 achieves superior accuracy & outperforms other leading quants.

  • Introducing Dynamic V3.0 GGUFs for SOTA accuracy and quantization performance
  • Run and fine-tune Qwen3.8 in Unsloth Desktop with Thinking toggles. Download for Mac, Windows and Linux. GitHub repo
  • Developer Role Support so Qwen3.8 can work in agentic tools like Codex and more!
  • Tool calling improvements: Makes parsing nested objects to make tool calling succeed more.
  • See below for 4-bit Qwen3.8-27B run inside of Unsloth Desktop:

Analysis of best Qwen3.8 GGUF providers. Unsloth Dynamic v3.0 delivers >10% top-1% better accuracy at the same size compared to every other provider. Read more


Qwen3.8-27B

Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.

Built on the architectural foundation of Qwen3.5, Qwen3.8 delivers substantial gains across coding, professional work, research, and long-horizon agentic tasks. Qwen3.8-27B brings these advances to a compact, deployment-friendly dense model: a native vision-language model that understands images and videos, with flexible thinking control, designed to carry complex, multi-step tasks through to completion with greater reliability.

Qwen3.8 Highlights

Qwen3.8-27B features the following enhancements: - Core Capabilities: Comprehensive improvements across coding, professional work, research, and long-horizon agentic tasks. - Agent Execution: Stronger autonomous planning and better handling of environment feedback, leading to more reliable end-to-end task completion. - Downstream Compatibility: Broader support for popular harnesses and development tools, making it easier to integrate into your existing stack. - Flexible Thinking Control: Thinking mode is on by default and can be disabled per request; reasoning depth can be tuned with reasoning_effort, and reasoning context from historical messages is retained via preserve_thinking. - Vision-Language Understanding: Native support for image and video understanding, from STEM diagrams and documents to hour-scale videos.

Model Overview

  • Type: Causal Language Model with Vision Encoder
  • Training Stage: Pre-training & Post-training
  • Language Model
    • Number of Parameters: 27B
    • Hidden Dimension: 5120
    • Token Embedding: 248,320 (Padded)
    • Number of Layers: 64
    • Hidden Layout: 16 × (3 × (Gated DeltaNet → FFN) → 1 × (Gated Attention → FFN))
    • Gated DeltaNet:
      • Number of Linear Attention Heads: 48 for V and 16 for QK
      • Head Dimension: 128
    • Gated Attention:
      • Number of Attention Heads: 24 for Q and 4 for KV
      • Head Dimension: 256
      • Rotary Position Embedding Dimension: 64
    • Feed Forward Network:
      • Intermediate Dimension: 17,408
    • LM Output: 248,320 (Padded)
    • MTP (Multi-Token Prediction): trained with multiple steps
  • Context Length: 262,144 natively and extensible up to 1,000,000 tokens.

Best Practices

To achieve optimal performance, we recommend the following settings:

  1. Sampling Parameters: We suggest using the following sets of sampling parameters:

    • Thinking Mode: temperature=1.0, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0
    • Instruct (or non-thinking) mode: temperature=0.7, top_p=0.80, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0

    For supported frameworks, you can adjust the presence_penalty parameter between 0 and 2 to reduce endless repetition. However, using a higher value may occasionally result in language mixing and a slight decrease in model performance.

  2. Adequate Output Length: To optimize performance on agentic tasks, we recommend allocating sufficient output length to allow the model to generate detailed and comprehensive responses. For frameworks that support separate token limits for internal reasoning and final outputs, we suggest the following configuration within the 1M context length:

    • Reasoning Content: Set the maximum output length to 262,144 tokens.
    • Final Response: Set the maximum output length to 131,072 tokens.

    These settings provide the necessary capacity for complex reasoning while ensuring ample space for high-quality final deliverables.

  3. Processing Ultra-Long Texts: Qwen3.8-27B natively supports context lengths of up to 262,144 tokens. For long-horizon tasks where the total length (including both input and output) exceeds this limit, we recommend using RoPE scaling techniques to handle long texts effectively, e.g., YaRN.

  4. Long Video Understanding: To optimize inference efficiency for plain text and images, the size parameter in the released video_preprocessor_config.json is conservatively configured. It is recommended to set the longest_edge parameter in the video_preprocessor_config file to 469,762,048 (corresponding to 224k video tokens) to enable higher frame-rate sampling for hour-scale videos and thereby achieve superior performance. For example, json {"longest_edge": 469762048, "shortest_edge": 4096}

Citation

If you find our work helpful, feel free to give us a cite.

@misc{qwen38,
    title = {{Qwen3.8-Max}: A New Bar for Coding and Cowork},
    url = {https://qwen.ai/blog?id=qwen3.8},
    author = {{Qwen Team}},
    month = {August},
    year = {2026}
}

Configuration

Architecture
Qwen3_5ForConditionalGeneration
Context length (tokens)
262,144
Layers
64
Hidden size
5,120
Feed-forward size
17,408
Attention heads
24
Key/value heads
4
Head dimension
256
Vocabulary size
248,320
Stored precision
bfloat16
Model type
qwen3_5

Identity and Version

Repository
unsloth/Qwen3.8-27B-GGUF
Publisher
Unsloth AI
Task
Not stated by the source
Modality
Other
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
4ca720788d1e01f1bff70c033e0d0028fd02e502
First published
2026-08-13
Last updated
2026-08-20

Files and Weights

33 files, 472.1 GB in total. The weights are 30 files totalling 472.1 GB in gguf.

Weights30 files · 472.1 GB
Configuration1 file · 3.8 KB
Documentation1 file · 7.5 KB
Repository1 file · 4.2 KB
Every file
FileTypeSizeSHA-256
BF16/Qwen3.8-27B-BF16-00001-of-00002.ggufWeights50.0 GB b9966e82b7a4
BF16/Qwen3.8-27B-BF16-00002-of-00002.ggufWeights4.7 GB 92e3943c4f9b
MTP/mtp-Qwen3.8-27B-Q4_0.ggufWeights1.4 GB 50d9ce5a6da3
Qwen3.8-27B-Q4_0.ggufWeights16.1 GB ede16c7b36e5
Qwen3.8-27B-Q4_1.ggufWeights17.5 GB 3e020514545c
Qwen3.8-27B-Q8_0.ggufWeights29.0 GB a680f44a0692
Qwen3.8-27B-UD-IQ1_M.ggufWeights6.7 GB 1b5165a7149e
Qwen3.8-27B-UD-IQ1_S.ggufWeights6.2 GB 3895b6eaa91e
Qwen3.8-27B-UD-IQ2_S.ggufWeights8.4 GB 7897d2c5a5ce
Qwen3.8-27B-UD-IQ2_XXS.ggufWeights7.3 GB e792d8fb3142
Qwen3.8-27B-UD-IQ3_S.ggufWeights12.0 GB d847e2c1e4aa
Qwen3.8-27B-UD-IQ3_XXS.ggufWeights10.9 GB c0b7c3038681
Qwen3.8-27B-UD-IQ4_XS.ggufWeights14.3 GB 40fac4050e94
Qwen3.8-27B-UD-Q2_K_XL.ggufWeights9.8 GB fd4730dd8aad
Qwen3.8-27B-UD-Q3_K_XL.ggufWeights13.1 GB 8c2a45ff85e7
Qwen3.8-27B-UD-Q4_K_M.ggufWeights16.5 GB 322e194ff797
Qwen3.8-27B-UD-Q4_K_S.ggufWeights15.4 GB 75bc9c8adba2
Qwen3.8-27B-UD-Q4_K_XL.ggufWeights17.6 GB 3f227079003a
Qwen3.8-27B-UD-Q5_K_M.ggufWeights19.8 GB 2de73110cb25
Qwen3.8-27B-UD-Q5_K_S.ggufWeights18.7 GB d8d62ffcf84d
Qwen3.8-27B-UD-Q5_K_XL.ggufWeights20.9 GB 8601193d3d57
Qwen3.8-27B-UD-Q6_K.ggufWeights22.0 GB c9c206812fbe
Qwen3.8-27B-UD-Q6_K_L.ggufWeights24.2 GB 121355b4c742
Qwen3.8-27B-UD-Q6_K_M.ggufWeights23.1 GB 493301830a59
Qwen3.8-27B-UD-Q6_K_XL.ggufWeights25.3 GB 701d8fa9ed21
Qwen3.8-27B-UD-Q8_K_L.ggufWeights28.0 GB 2a13bba36d2e
Qwen3.8-27B-UD-Q8_K_XL.ggufWeights31.5 GB af36ecb6b5db
imatrix_unsloth.ggufWeights13.6 MB 0ee5b10bd0c2
mmproj-BF16.ggufWeights931.1 MB 83ee4f4f205f
mmproj-F16.ggufWeights927.6 MB cbb841a9ee06
config.jsonConfiguration3.8 KB
README.mdDocumentation7.5 KB
.gitattributesRepository4.2 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
472.1 GB
Download from Unsloth AI

Released by Unsloth AI through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published472.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Questions About Qwen3.8-27B-GGUF

Can I use Qwen3.8-27B-GGUF commercially?

Yes. Qwen3.8-27B-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is Qwen3.8-27B-GGUF's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.