SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

Qwen3.8-Flash-Next-4bit-paged

by GREENBITAI GreenBitAI/Qwen3.8-Flash-Next-4bit-paged

Expert-paged build of Vontra/Qwen3.8-Flash-Next-MLX-4bit. The weights that are read a fraction at a time live in their own containers, so a machine loads what it needs rather than all Total 105.46 GiB.

Parameters5.4B
Context262,144
Weights81.2 GB
Licenseother
AccessOpen weights
Monthly Downloads623

Runs On

What it takes to serve Qwen3.8-Flash-Next-4bit-paged (5.4B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 10.8 GB 13.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 5.4 GB 6.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 2.7 GB 3.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

Expert-paged build of Vontra/Qwen3.8-Flash-Next-MLX-4bit. The weights that are read a fraction at a time live in their own containers, so a machine loads what it needs rather than all Total 105.46 GiB. Of that, 103.94 GiB is the source build, whose bytes moved into containers rather than being copied, and 1.52 GiB is the draft head, which no published build of this model carries. Where the weights fit they are filled from experts.bin and the model runs the stock path at stock speed; where they do not, they stream from disk. Reading the machine decides that, not a flag. To override that: GBXPAGING=off holds the experts resident, GBXPLE=off holds the n-gram table resident. Checked at build…

Excerpt from the card by GREENBITAI, licensed other.

Configuration

Architecture
Qwen4ExpForConditionalGeneration
Context length (tokens)
262,144
Layers
48
Hidden size
2,560
Attention heads
24
Key/value heads
2
Head dimension
256
Vocabulary size
248,320
Experts
512
Experts active per token
10
Model type
qwen4_exp

Identity and Version

Repository
GreenBitAI/Qwen3.8-Flash-Next-4bit-paged
Publisher
GREENBITAI
Task
Image and text to text
Modality
Image and text
Library
mlx
Parameters
5.4B parameters
Languages
mlx, mlx-vlm
Revision
42134c602a79e2a2aa68dee673548a58aa42f1a0
First published
2026-08-29
Last updated
2026-09-18

Files and Weights

18 files, 113.2 GB in total. The weights are 3 files totalling 81.2 GB in bin, safetensors.

Weights3 files · 81.2 GB
Configuration6 files · 292.0 KB
Tokenizer4 files · 22.9 MB
Documentation2 files · 6.1 KB
Other2 files · 32.0 GB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
experts.binWeights75.5 GB c740bd82904e
model.safetensorsWeights4.1 GB 9badfce7142d
mtp/mtp.safetensorsWeights1.6 GB e8b3e6d05496
config.jsonConfiguration23.7 KB
experts_index.jsonConfiguration3.2 KB
generation_config.jsonConfiguration202 B
model.safetensors.index.jsonConfiguration262.3 KB
ple_index.jsonConfiguration2.1 KB
preprocessor_config.jsonConfiguration390 B
LICENSEDocumentation3.2 KB
README.mdDocumentation2.8 KB
chat_template.jinjaOther9.0 KB
ple-q4.rowsOther32.0 GB 334db78ced60
.gitattributesRepository1.6 KB
merges.txtTokenizer3.4 MB
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer17.9 KB
vocab.jsonTokenizer6.7 MB

License and Download

License
other
Access
Open weights, no gate
Download size
81.2 GB
Download from GREENBITAI

Released by GREENBITAI through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published81.2 GB
16-bit10.8 GB
8-bit5.4 GB
4-bit2.7 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.8-Flash-Next-4bit-paged

How much GPU memory does Qwen3.8-Flash-Next-4bit-paged need?

About 13 GB at 16-bit and 3.2 GB at 4-bit: the weights (5.4B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen3.8-Flash-Next-4bit-paged on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Qwen3.8-Flash-Next-4bit-paged released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen3.8-Flash-Next-4bit-paged's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

chandra-ocr-2

Datalab

Chandra 2 is a state of the art OCR model from Datalab that outputs markdown, HTML, and JSON. It is highly accurate at extracting text from images and PDFs, while preserving layout information. Try Chandra in the free playground, or use the hosted API for higher accuracy and speed. - 85.8% olmocr bench score (sota), 77.8% multilingual bench score (12% improvement over Chandra 1) - Significant improvements to math, tables, complex layouts - 90+ language support with major accuracy gains - Convert documents to markdown, HTML, or JSON with detailed layout information - Reconstructs forms accurately, including checkboxes - Strong performance with tables, math, and complex layouts - Extracts…

Open weights openrail 5.3B parameters 262,144 tokens transformers

Model · Image and text to text

vllm-translategemma-4b-it

Infomaniak Network SA

This is a modified version of google/translategemma-4b-it optimized for deployment with vLLM. The original TranslateGemma model requires a structured payload with dedicated sourcelangcode and targetlangcode fields: However, vLLM does not support these custom content parameters. To maintain compatibility, the chat template has been modified to encode language codes directly in the message content using a delimiter-based format: Format: >>{sourcelang} >>{targetlang} >>{texttotranslate} If you need to provide a custom prompt input The original model uses the new Transformers RoPE configuration format with separate attention type settings: This has been simplified for vLLM compatibility: The…

Open weights gemma 5B parameters 131,072 tokens transformers

Model · Image and text to text

Qwen3.5-4B

Qwen

Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. For more details, please refer to our blog post Qwen3.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not applicable. Empty cells (--) indicate scores not…

Open weights apache-2.0 4.7B parameters 262,144 tokens transformers

Model · Image and text to text

Omni-Edu-4B

Hao Liang

This model is a fine-tuned version of Qwen/Qwen3.5-4B-Base on the Omni-Edu-70K dataset. The following hyperparameters were used during training: - learningrate: 5e-06 - trainbatchsize: 1 - evalbatchsize: 8 - distributedtype: multi-GPU - numdevices: 8 - gradientaccumulationsteps: 8 - totaltrainbatchsize: 64 - totalevalbatchsize: 64 - lrschedulertype: cosine - lrschedulerwarmupsteps: 0.1 - numepochs: 3.0 - Transformers 5.2.0 - Pytorch 2.10.0 - Datasets 4.0.0 - Tokenizers 0.22.2

Open weights other 4.5B parameters 262,144 tokens transformers

Model · Image and text to text

Huihui-Qwen3.6-27B-abliterated-AWQ-MTP

Shawn Wei

This is an uncensored version of Qwen/Qwen3.6-27B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. - AWQ Marlin kernel supported (auto-converted by vLLM at runtime) - MTP speculative decoding supported out of the box - 110+ tok/s on a single A800 80GB (vLLM 0.21.0, MTP enabled, fp8 KV cache) - Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated…

Open weights apache-2.0 6.3B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen3-VL-4B-Instruct

Qwen

Meet Qwen3-VL — the most powerful vision-language model in the Qwen series to date. This generation delivers comprehensive upgrades across the board: superior text understanding & generation, deeper visual perception & reasoning, extended context length, enhanced spatial and video dynamics comprehension, and stronger agent interaction capabilities. Available in Dense and MoE architectures that scale from edge to cloud, with Instruct and reasoning‑enhanced Thinking editions for flexible, on‑demand deployment. Text Understanding on par with pure LLMs: Seamless text–vision fusion for lossless, unified comprehension. 1. Interleaved-MRoPE: Full‑frequency allocation over time, width, and height…

Open weights apache-2.0 4.4B parameters 262,144 tokens transformers