Skip to page content
SAVRN
Search Plan a project

Open-weight model · Zero-shot classification

d3-oQ4e

by Jun Kim Jundot/d3-oQ4e

d3-oQ4e is an open-weight model for zero-shot classification from Jun Kim, released under Apache License 2.0. It has 26.1B parameters and a 262,144-token context. At 16-bit it needs about 62.6 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385).

Parameters26.1B
Context262,144
Weights15.9 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve d3-oQ4e (26.1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 52.2 GB 62.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 26.1 GB 31.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 13.0 GB 15.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

d3-oQ4e on every accelerator the SAVRN Index prices, at every precision

Model Card

By Jun Kim, published under apache-2.0, revision 1d58470afd02.

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385). A mixed-precision MLX checkpoint of vllm-sr/d3, the 27B multimodal decision model of Decision 3.0 from vLLM Semantic Router, built on Qwen/Qwen3.8-27B. It reads text or JSON with optional images and videos and returns a probability for every option of choice, yes/no and score questions without generating text. It includes the language backbone, the vision encoder and the code readout. The code readout (readout.safetensors, FP32) and decisionconfig.json are copied unchanged from the source. oMLX serves this checkpoint through POST /v1/systemone; Decision 3.0 support…

Read Jun Kim's full model card

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385).

A mixed-precision MLX checkpoint of vllm-sr/d3, the 27B multimodal decision model of Decision 3.0 from vLLM Semantic Router, built on Qwen/Qwen3.8-27B. It reads text or JSON with optional images and videos and returns a probability for every option of choice, yes/no and score questions without generating text. It includes the language backbone, the vision encoder and the code readout.

The code readout (readout.safetensors, FP32) and decision_config.json are copied unchanged from the source. oMLX serves this checkpoint through POST /v1/systemone; Decision 3.0 support (jundot/omlx#4470) is newer than oMLX v0.7.1.dev1.

The effective average is 4.880 bits/weight for the complete checkpoint.

Quantization and Bit Distribution

oQ4e allocates bits by measured layer sensitivity, then rounds each group with an importance matrix (128 samples x 512 tokens) and a weighted least-squares refit of its scale and bias.

Storage format Logical weights Share of total Tensor storage Effective bits/weight
Affine 4-bit, group 64 21.075B 80.790% 11.041 GiB 4.50
Affine 5-bit, group 64 4.547B 17.429% 2.911 GiB 5.50
BF16 0.463B 1.776% 0.863 GiB 16.00
FP32 0.001B 0.005% 0.005 GiB 32.00
Total 26.087B 100% 14.820 GiB 4.880

Storage Breakdown

Component Logical weights Storage
Language backbone 25.625B 14.986 GB / 13.957 GiB
Vision encoder 0.461B 0.921 GB / 0.858 GiB
Code readout 0.001B 0.005 GB / 0.005 GiB
Total 26.087B 15.913 GB / 14.820 GiB

License

Apache-2.0, following the source model. See LICENSE and NOTICE.

Configuration

Architecture
Qwen3_5Model
Context length (tokens)
262,144
Layers
64
Hidden size
5,120
Feed-forward size
17,408
Attention heads
24
Key/value heads
4
Head dimension
256
Vocabulary size
248,320
Model type
qwen3_5

Identity and Version

Repository
Jundot/d3-oQ4e
Publisher
Jun Kim
Task
Zero-shot classification
Modality
Text
Library
mlx
Parameters
26.1B parameters
Languages
mlx, oq
Revision
1d58470afd02462331600ab4b19a863d00057775
First published
2026-10-13
Last updated
2026-10-13

Files and Weights

27 files, 15.9 GB in total. The weights are 5 files totalling 15.9 GB in safetensors.

Weights5 files · 15.9 GB
Configuration13 files · 470.5 KB
Tokenizer4 files · 22.9 MB
Documentation3 files · 13.7 KB
Other1 file · 9.0 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00004.safetensorsWeights5.0 GB 7572223f0112
model-00002-of-00004.safetensorsWeights5.0 GB 37895def7068
model-00003-of-00004.safetensorsWeights5.0 GB 2b21d9474593
model-00004-of-00004.safetensorsWeights838.4 MB 2ace31645c99
readout.safetensorsWeights5.2 MB 5319cbf3ccdc
config.jsonConfiguration47.9 KB —
d3_engine.pyConfiguration4.4 KB —
d3_fast.pyConfiguration22.3 KB —
d3_format.pyConfiguration7.0 KB —
d3_kernels.pyConfiguration16.1 KB —
d3_runtime.pyConfiguration94.0 KB —
d3_server.pyConfiguration17.7 KB —
decision_config.jsonConfiguration5.5 KB —
model.safetensors.index.jsonConfiguration209.3 KB —
modeling_d3.pyConfiguration12.1 KB —
oq_imatrix_report.jsonConfiguration30.8 KB —
pipeline_d3.pyConfiguration2.9 KB —
preprocessor_config.jsonConfiguration390 B —
LICENSEDocumentation11.4 KB —
NOTICEDocumentation100 B —
README.mdDocumentation2.2 KB —
chat_template.jinjaOther9.0 KB —
.gitattributesRepository1.6 KB —
merges.txtTokenizer3.4 MB —
tokenizer.jsonTokenizer12.8 MB 0997f410c57a
tokenizer_config.jsonTokenizer17.9 KB —
vocab.jsonTokenizer6.7 MB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
15.9 GB
Download from Jun Kim

Released by Jun Kim through its official repository on Hugging Face. Read the license.

Built From

  • Derived from vllm-sr/d3
  • Quantized from vllm-sr/d3

Memory Requirements

PrecisionWeights in memory
As published15.9 GB
16-bit52.2 GB
8-bit26.1 GB
4-bit13.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About d3-oQ4e

How much GPU memory does d3-oQ4e need?

About 62.6 GB at 16-bit and 15.7 GB at 4-bit: the weights (26.1B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run d3-oQ4e on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use d3-oQ4e commercially?

Yes. d3-oQ4e is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is d3-oQ4e's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Zero-shot classification

matilda-jev-v1

Maincode

Matilda-Jev is Maincode's one-pass decision model. It scores the options supplied in a choice, noul (yes/no), or ordered score question. It accepts text or JSON state and optional images. This is a decision checkpoint with a 255-option readout, not a text-generation checkpoint. This configuration edition uses MatildaJevModel, MatildaJevConfig, and MATILDA tokenizer/processor classes. Use the bundled runtime below, or load the custom AutoClasses with trustremotecode=True. The package includes the backbone weights, decision readout, tokenizer, preprocessing configuration and calibrated temperature. On AMD MI355X with Python 3.12, Transformers 5.17.0 and PyTorch 2.14.0: - 25/25 smoke-test…

Open weights apache-2.0 26.1B parameters 262,144 tokens transformers

Model · Zero-shot classification

matilda-jev-v1.5

Maincode

A BF16 JEV decision model with a 255-option readout. This is the highest-scoring checkpoint in the completed MATILDA JEV experiments as of 9 October 2026: Decision Index 63.47 (0.3 public suite). The model accepts a state and one or more decision questions. It supports choice, noul (probability of true), and ordinal score. Inference is one forward pass per question; the model has no text-generation head and does not generate a chain of thought. The LoRA updates are already merged into the weights. No adapter merge is required. Use Python 3.12 or newer and install PyTorch for your accelerator. The validated cluster environment uses PyTorch 2.14.0, Transformers 5.17.0, and an AMD Instinct…

Open weights apache-2.0 26.1B parameters 262,144 tokens transformers

Model · Zero-shot classification

d3-oQ8e

Jun Kim

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385). A mixed-precision MLX checkpoint of vllm-sr/d3, the 27B multimodal decision model of Decision 3.0 from vLLM Semantic Router, built on Qwen/Qwen3.8-27B. It reads text or JSON with optional images and videos and returns a probability for every option of choice, yes/no and score questions without generating text. It includes the language backbone, the vision encoder and the code readout. The code readout (readout.safetensors, FP32) and decisionconfig.json are copied unchanged from the source. oMLX serves this checkpoint through POST /v1/systemone; Decision 3.0 support…

Open weights apache-2.0 26.1B parameters 262,144 tokens mlx

Model · Zero-shot classification

d3-W4A16-G128-AWQ

Park Soobin

d3-W4A16-G128-AWQ is an unofficial INT4 weight-only (W4A16) AWQ quantization of d3, the 27B multimodal foundation decision model of Decision 3.0. It takes the same inputs and questions as d3 and returns a probability for every answer, without generating text, with 16.5 GB of weights instead of 52 GB. - Keeps 97.76% of d3's answers on the 14,031 test requests of tasksource-jev-typed-decisions, with accuracy 83.09% against BF16's 83.25%. - 16.9 GB of GPU memory after loading instead of 52.3 GB, and 17.5 GB at the peak of the 20 longest of 1,000 text requests (up to 5,928 characters of state) on an MI300X. - Reads images and videos as d3 does: the vision tower is unchanged, and d3's example…

Open weights apache-2.0 26.1B parameters 262,144 tokens transformers

Model · Zero-shot classification

bobcat-flash-1.2

Sanghwa Na

Bobcat Flash 1.2 · Bobcat Flash 1.2 FP8 · Try it in the Space · Code on GitHub Bobcat Flash is the fast tier of Bobcat, a typed-decision model. You send a state (text or JSON) and questions whose possible answers you define in the request; Flash returns a probability for every answer you named, and nothing else. It never generates text: it reads the logits of the offered candidates at the first answer position of one forward pass, and the host builds a closed JSON reply from your own names. An answer can be wrong, but it cannot be malformed. This repository, sanghwa-na/bobcat-flash-1.2, holds Bobcat Flash 1.2 as ready-to-serve BF16 weights on google/gemma-4-26B-A4B-it (Apache-2.0) at…

Open weights apache-2.0 25.8B parameters 262,144 tokens transformers

Model · Zero-shot classification

bobcat-flash-1.2-fp8

Sanghwa Na

A pre-quantized FP8 checkpoint of Bobcat Flash 1.2, the fast tier of the typed-decision model Bobcat: you send a state and questions whose answers you name, and it returns a probability for every answer you named; it never generates text. Evaluation, training data, limitations and the full license notes are on the main card, This repository, sanghwa-na/bobcat-flash-1.2-fp8, is the BF16 weights of sanghwa-na/bobcat-flash-1.2 quantized to FP8 (27.2 GB, FP8DYNAMIC, every expert included): float8e4m3fn weights with one scale per output channel, activations quantized per token at run time, in the compressed-tensors format that vLLM loads as it is. It is the checkpoint the Bobcat Flash Space…

Open weights apache-2.0 25.8B parameters 262,144 tokens transformers