SAVRN
Search Contact SAVRN

Open-weight model · Text generation

Qwen3.8-Flash-Next-Abliterated-EXL3-2.50bpw

by Ghost ghost-actual/Qwen3.8-Flash-Next-Abliterated-EXL3-2.50bpw

A refusal-removed (abliterated) build of Qwen's Qwen3.8-Flash-Next, quantized to EXL3 2.50 bpw so the full model runs on a single 24 GB card (RTX 3090 / 4090) using MoE CPU-offload — with the vision tower, MTP head, native 262,144-token context, and the PLE…

Parameters22.3B
Context262,144
Weights64.4 GB
Licenseother
AccessOpen weights
Monthly Downloads

Runs On

What it takes to serve Qwen3.8-Flash-Next-Abliterated-EXL3-2.50bpw (22.3B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 44.5 GB 53.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 22.3 GB 26.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 11.1 GB 13.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

A refusal-removed (abliterated) build of Qwen's Qwen3.8-Flash-Next, quantized to EXL3 2.50 bpw so the full model runs on a single 24 GB card (RTX 3090 / 4090) using MoE CPU-offload — with the vision tower, MTP head, native 262,144-token context, and the PLE n-gram table all intact. Requires the same MoE CPU-offload setup as the stock 2.50bpw pack. Needs ~59 GB host RAM for the CPU expert tail and a fast NVMe for the streamed n-gram table. Expected on an RTX 3090: ~38 tok/s decode with MTP on (~28 without), ~20 tok/s at 175K depth, ~664 tok/s prefill. See the upstream repo for the full measured ledger; this quant uses the identical flags and layout, so numbers should track closely. Fired on…

Excerpt from the card by Ghost, licensed other.

Configuration

Architecture
Qwen4ExpForConditionalGeneration
Context length (tokens)
262,144
Layers
48
Hidden size
2,560
Attention heads
24
Key/value heads
2
Head dimension
256
Vocabulary size
248,320
Experts
512
Experts active per token
10
Model type
qwen4_exp

Identity and Version

Repository
ghost-actual/Qwen3.8-Flash-Next-Abliterated-EXL3-2.50bpw
Publisher
Ghost
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
22.3B parameters
Languages
moe, mtp
Revision
6026e96af86f821a15e40c4cccde06cc441266ab
First published
2026-09-18
Last updated
2026-09-18

Files and Weights

21 files, 64.6 GB in total. The weights are 7 files totalling 64.4 GB in safetensors.

Weights7 files · 64.4 GB
Configuration6 files · 129.4 MB
Tokenizer4 files · 22.9 MB
Documentation2 files · 7.9 KB
Other1 file · 9.0 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00006.safetensorsWeights8.4 GB d0aa92d89aaa
model-00002-of-00006.safetensorsWeights8.6 GB 6958ad079d6f
model-00003-of-00006.safetensorsWeights8.4 GB 6c0526b0e4c3
model-00004-of-00006.safetensorsWeights7.6 GB 70c2ac31f271
model-00005-of-00006.safetensorsWeights8.1 GB 81e5389b2b9e
model-00006-of-00006.safetensorsWeights3.4 GB 8904ff5ecbbc
ngram_embedding.safetensorsWeights19.8 GB e1d9ba8d9c15
config.jsonConfiguration4.0 KB
generation_config.jsonConfiguration202 B
model.safetensors.index.jsonConfiguration32.8 MB 76413d05eb8c
preprocessor_config.jsonConfiguration390 B
quantization_config.jsonConfiguration96.6 MB 913478aae683
video_preprocessor_config.jsonConfiguration385 B
LICENSEDocumentation3.2 KB
README.mdDocumentation4.7 KB
chat_template.jinjaOther9.0 KB
.gitattributesRepository1.7 KB
merges.txtTokenizer3.4 MB
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer17.9 KB
vocab.jsonTokenizer6.7 MB

License and Download

License
other
Access
Open weights, no gate
Download size
64.4 GB
Download from Ghost

Released by Ghost through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published64.4 GB
16-bit44.5 GB
8-bit22.3 GB
4-bit11.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen3.8-Flash-Next-Abliterated-EXL3-2.50bpw

How much GPU memory does Qwen3.8-Flash-Next-Abliterated-EXL3-2.50bpw need?

About 53.4 GB at 16-bit and 13.4 GB at 4-bit: the weights (22.3B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen3.8-Flash-Next-Abliterated-EXL3-2.50bpw on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Qwen3.8-Flash-Next-Abliterated-EXL3-2.50bpw released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen3.8-Flash-Next-Abliterated-EXL3-2.50bpw's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

gpt-oss-20b

OpenAI

Welcome to the gpt-oss series, OpenAI’s open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases. We’re releasing two flavors of these open models: - gpt-oss-120b — for production, general purpose, high reasoning use cases that fit into a single 80GB GPU (like NVIDIA H100 or AMD MI300X) (117B parameters with 5.1B active parameters) - gpt-oss-20b — for lower latency, and local or specialized use cases (21B parameters with 3.6B active parameters) Both models were trained on our harmony response format and should only be used with the harmony format as it will not work correctly otherwise. You can use gpt-oss-120b and gpt-oss-20b with Transformers.…

Open weights apache-2.0 20.9B parameters 131,072 tokens transformers

Model · Text generation

Gemma-4-31B-IT-NVFP4

NVIDIA

Gemma 4 31B IT is an open multimodal model built by Google DeepMind that handles text and image inputs, can process video as sequences of frames, and generates text output. It is designed to deliver frontier-level performance for reasoning, agentic workflows, coding, and multimodal understanding on consumer GPUs and workstations, with a 256K-token context window and support for over 140 languages. The model uses a hybrid attention mechanism that interleaves local sliding-window and full global attention, with unified Keys and Values in global layers and Proportional RoPE (p-RoPE) to support long-context performance. The NVIDIA Gemma 4 31B IT NVFP4 model is quantized with NVIDIA Model…

Open weights other 20.9B parameters 262,144 tokens Model Optimizer

Model · Text generation

gpt-neox-20b

EleutherAI

GPT-NeoX-20B is a 20 billion parameter autoregressive language model trained on the Pile using the GPT-NeoX library. Its architecture intentionally resembles that of GPT-3, and is almost identical to that of GPT-J- 6B. Its training dataset contains a multitude of English-language texts, reflecting the general-purpose nature of this model. See the accompanying paper for details about model architecture (including how it differs from GPT-3), training procedure, and additional evaluations. Model](https://arxiv.org/abs/2204.06745). For details about the training dataset, see the Pile paper, and its data sheet. Discord](https://discord.gg/zBGx3azzUn), and post them in #release-discussion. Please…

Open weights apache-2.0 20.7B parameters 2,048 tokens transformers

Model · Text generation

Ornith-1.5-35B-A3B-NVFP4

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit 19.5B parameters 262,144 tokens transformers

Model · Text generation

WaifuGemma4-26b-a4b-v1

HiWaifu Research

Gemma 4 26B-A4B, post-trained with GRPO against a reward model learned from 1.2 million double-blind votes cast by HiWaifu users inside their own role-play conversations. Put back into the same arena, blind, it met GLM-5.1 in 1,430 battles and won 49.6% of the decided votes; against a 13-model field including Gemini, DeepSeek-v4 and Qwen's character models it won 54.7%. Most open role-play models are tuned on preferences that come from an LLM judge, from a handful of annotators, or from synthetic pairs. We had something rarer: a live arena where, inside ordinary chats on our platform, a user is occasionally shown two candidate replies and asked which one they want to continue with. Those…

Open weights gemma 25.8B parameters 262,144 tokens transformers

Model · Text generation

Qwen3.6-35B-A3B-NVFP4

NVIDIA

The NVIDIA Qwen3.6-35B-A3B-NVFP4 model is the quantized version of Alibaba's Qwen3.6-35B-A3B model, which is an auto-regressive language model that uses an optimized transformer architecture. For more information, please check here. The NVIDIA Qwen3.6-35B-A3B-NVFP4 model is quantized with Model Optimizer. This model is ready for commercial/non-commercial use. This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party’s requirements for this application and use case; see link to Non-NVIDIA (Qwen3.6-35B-A3B) Model Card from Alibaba. Global Developers looking to take off-the-shelf, pre-quantized models for deployment in AI Agent systems, chatbots…

Open weights apache-2.0 18.7B parameters 262,144 tokens Model Optimizer