SAVRN
Search Contact SAVRN

Open-weight model · Text generation

StandardOne-8B-FP8

by Standard Thinking StandardThinking/StandardOne-8B-FP8

StandardOne-8B-FP8 is an open-weight model for text generation from Standard Thinking, released under Apache License 2.0. It has 8.9B parameters and a 262,144-token context. At 16-bit it needs about 21.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 38 downloads a month.

StandardOne-8B-FP8 is an FP8 (compressed-tensors, float8e4m3 weights, dynamic per-token activations) quantization of the released StandardOne-8B decision model.

Parameters8.9B
Context262,144
Weights10.4 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads38

Runs On

What it takes to serve StandardOne-8B-FP8 (8.9B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 17.8 GB 21.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 8.9 GB 10.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.5 GB 5.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 7, 2026.

StandardOne-8B-FP8 on every accelerator the SAVRN Index prices, at every precision

Model Card

By Standard Thinking, published under apache-2.0, revision 4ca41ec1239c.

StandardOne-8B-FP8 is an FP8 (compressed-tensors, float8e4m3 weights, dynamic per-token activations) quantization of the released StandardOne-8B decision model. The language-model linear projections (q/k/v/o, gate/up/down) are quantized per-channel FP8 E4M3 with dynamic FP8 activations (llm-compressor's data-free FP8DYNAMIC recipe, no calibration data required); the vision tower, multi-modal projector, embeddings and lmhead are left unquantized in BF16. It was produced from source revision e88423700bb5ab9b2f50e176cf19825914345272 of StandardOne-8B on 2026-09-25 using llm-compressor 0.14.0 (torch 2.14.0, transformers 5.17.0, compressed-tensors 0.19.0); results below. Served through SGLang…

Read Standard Thinking's full model card

StandardOne-8B-FP8 is an FP8 (compressed-tensors, float8_e4m3 weights, dynamic per-token activations) quantization of the released StandardOne-8B decision model. The language-model linear projections (q/k/v/o, gate/up/down) are quantized per-channel FP8 E4M3 with dynamic FP8 activations (llm-compressor's data-free FP8_DYNAMIC recipe, no calibration data required); the vision tower, multi-modal projector, embeddings and lm_head are left unquantized in BF16. It was produced from source revision e88423700bb5ab9b2f50e176cf19825914345272 of StandardOne-8B on 2026-09-25 using llm-compressor 0.14.0 (torch 2.14.0, transformers 5.17.0, compressed-tensors 0.19.0); results below.

Validation

Served through SGLang 0.5.20 and jev-adapter (native wording, no system prompt, one option order) on the same items as the BF16 release, measured 2026-09-25. Accuracy is argmax and does not depend on temperature.

Suite BF16 (StandardOne-8B) FP8 (this repository)
JevBench public easy (48) 100.00 % 100.00 %
JevBench public standard (72) 94.44 % 94.44 %
JevBench public hard (111) 54.95 % 51.35 %
judge proxy (600) 90.50 % 90.17 %
realistic transfer set (600) 90.33 % 90.00 %
stated-distribution probability (1,036) 81.37 % 81.27 %
hard proxy (600) 52.50 % 52.33 %

Temperature refit on this checkpoint's own served probabilities (same held-out calibration data as the BF16 release): T = 1.4 (BF16 release: T = 1.65). Serve with --default-temperature 1.4.

Configuration

Architecture
Mistral3ForConditionalGeneration
Context length (tokens)
262,144
Layers
34
Hidden size
4,096
Feed-forward size
14,336
Attention heads
32
Key/value heads
8
Head dimension
128
Vocabulary size
131,072
Model type
mistral3
Quantization
compressed-tensors

Identity and Version

Repository
StandardThinking/StandardOne-8B-FP8
Publisher
Standard Thinking
Task
Text generation
Modality
Text
Library
transformers
Parameters
8.9B parameters
Languages
jev
Revision
4ca41ec1239c581d82fdd2f18011a205df404220
First published
2026-09-24
Last updated
2026-09-27

Files and Weights

18 files, 10.5 GB in total. The weights are 1 file totalling 10.4 GB in safetensors.

Weights1 file · 10.4 GB
Configuration8 files · 16.9 MB
Tokenizer2 files · 17.3 MB
Documentation3 files · 14.4 KB
Other3 files · 15.6 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights10.4 GB ab309fc15908
config.jsonConfiguration13.7 KB —
generation_config.jsonConfiguration131 B —
params.jsonConfiguration1.1 KB —
processor_config.jsonConfiguration976 B —
recipe.yamlConfiguration293 B —
release-manifest.jsonConfiguration1.8 KB —
special_tokens_map.jsonConfiguration147.1 KB —
tekken.jsonConfiguration16.8 MB 600bb2794656
LICENSEDocumentation11.3 KB —
NOTICEDocumentation1.2 KB —
README.mdDocumentation1.8 KB —
SHA256SUMSOther1.3 KB —
SYSTEM_PROMPT.txtOther2.4 KB —
chat_template.jinjaOther11.9 KB —
.gitattributesRepository1.6 KB —
tokenizer.jsonTokenizer17.1 MB d5f6046775b1
tokenizer_config.jsonTokenizer198.1 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
10.4 GB
Download from Standard Thinking

Released by Standard Thinking through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published10.4 GB
16-bit17.8 GB
8-bit8.9 GB
4-bit4.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About StandardOne-8B-FP8

How much GPU memory does StandardOne-8B-FP8 need?

About 21.4 GB at 16-bit and 5.4 GB at 4-bit: the weights (8.9B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run StandardOne-8B-FP8 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use StandardOne-8B-FP8 commercially?

Yes. StandardOne-8B-FP8 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is StandardOne-8B-FP8's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

StandardOne-8B

Standard Thinking

Standard One scores a bounded set of answers for a supplied scenario and returns probabilities through POST /v1/systemone. It does not generate free-form response text. This repository contains the merged BF16 8B checkpoint and the server code. In the reported served evaluations, 8B scores higher than 3B on the public standard and hard tiers; 3B has a lower median latency on the measured short-request profile. See Benchmarks for the measurement conditions and limitations. The figure combines results from different measurement paths. See Benchmarks for served versus offline conditions; measured 24–26 September 2026. - Send a state and a bounded rubric to receive probabilities for the…

Open weights apache-2.0 8.9B parameters 262,144 tokens transformers

Model · Text generation

idefics-9b

HuggingFaceM4

How do I pronounce the model's name? Watch a Youtube tutorial IDEFICS (Image-aware Decoder Enhanced à la Flamingo with Interleaved Cross-attentionS) is an open-access reproduction of Flamingo, a closed-source visual language model developed by Deepmind. Like GPT-4, the multimodal model accepts arbitrary sequences of image and text inputs and produces text outputs. IDEFICS is built solely on publicly available data and models. The model can answer questions about images, describe visual contents, create stories grounded on multiple images, or simply behave as a pure language model without visual inputs. IDEFICS is on par with the original closed-source model on various image-text benchmarks…

Open weights other 8.9B parameters 2,048 tokens transformers

Model · Text generation

dQwen3.5-9B-Base

IFML

A masked diffusion language model adapted from Qwen3.5-9B. The backbone is hybrid: only its attention layers are made bidirectional, and the Gated DeltaNet layers stay causal. This is a base model, with no instruction tuning. Paper: dQwen3.5: Hybrid-Attention Diffusion Language Models. Code: https://github.com/AntonXue/dQwen Needs a CUDA GPU and transformers>=5.13 (tested with torch 2.7.1+cu128, flash-linear-attention 0.5.1). generate decodes the whole canvas at once, committing positions above a confidence threshold (tau=0.9); pass blocklength=32 for left-to-right block decoding, or tau=None, stepsperblock=k for a fixed budget. The 50B-token checkpoint from the paper is…

Open weights apache-2.0 9B parameters 262,144 tokens transformers

Model · Text generation

WikiQwen-9B

Devon Yanitski

Ask anything, get a how-to article. WikiQwen-9B is Qwen3.5-9B fine-tuned to answer every message the same way: as a tidy, step-by-step how-to article in markdown, with a picture caption above each step. Hand those captions to WikiQwen-Illustrator and they become illustrations. Send it a question ("how do I keep basil alive?"), a problem ("my bike chain keeps falling off") or just "hi", and it sends back a guide. Every reply has the same shape: - a # How to … title and a short intro - one or more ## Method N: or ## Part N: sections, or a single ## Steps - an [IMAGE: caption] line above each step, written for the Illustrator to draw - steps written as N. Bold summary. Details…, with bullets…

Open weights cc-by-nc-sa-4.0 9B parameters 262,144 tokens transformers

Model · Text generation

zkhapo3.5-9b

Zkhapo

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Open weights 9B parameters 262,144 tokens transformers