Skip to page content
SAVRN
Search Plan a project

Open-weight model · Image and text to text

Omni-Edu-9B-FP8

by Hao Liang lhpku20010120/Omni-Edu-9B-FP8

Omni-Edu-9B-FP8 is an open-weight model for image and text to text from Hao Liang, released under other. It has 9.4B parameters and a 262,144-token context. At 16-bit it needs about 22.6 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

Open Foundation Models for Learning and Teaching OmniEdu-9B-FP8 is the FP8-quantized release of OmniEdu-9B.

Parameters9.4B
Context262,144
Weights11.9 GB
Licenseother
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve Omni-Edu-9B-FP8 (9.4B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 18.8 GB 22.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 9.4 GB 11.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.7 GB 5.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 23, 2026.

Omni-Edu-9B-FP8 on every accelerator the SAVRN Index prices, at every precision

Model Card

Open Foundation Models for Learning and Teaching OmniEdu-9B-FP8 is the FP8-quantized release of OmniEdu-9B. The architecture, tokenizer, chat template and instruction-tuning data are unchanged: this checkpoint is the same model with its linear layers stored in FP8, which shrinks the weights from 17.53 GiB to 11.09 GiB and is intended for deployment on smaller GPUs and for higher-throughput serving. This checkpoint accompanies OmniEdu: Open Foundation Models for Learning and University · University of the Chinese Academy of Sciences · Zhongguancun Academy Quantized with LLM Compressor into the compressed-tensors FP8BLOCK scheme (library version 0.19.0), without calibration data: The vision…

Excerpt from the card by Hao Liang, licensed other.

Configuration

Architecture
Qwen3_5ForConditionalGeneration
Context length (tokens)
262,144
Layers
32
Hidden size
4,096
Feed-forward size
12,288
Attention heads
16
Key/value heads
4
Head dimension
256
Vocabulary size
248,320
Model type
qwen3_5
Quantization
compressed-tensors

Identity and Version

Repository
lhpku20010120/Omni-Edu-9B-FP8
Publisher
Hao Liang
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
9.4B parameters
Languages
Not stated by the source
Revision
c607ce1d8c402a635fd314a812d645263a012c31
First published
2026-10-05
Last updated
2026-10-06

Files and Weights

10 files, 11.9 GB in total. The weights are 1 file totalling 11.9 GB in safetensors.

Weights1 file · 11.9 GB
Configuration4 files · 20.7 KB
Tokenizer2 files · 20.0 MB
Documentation1 file · 11.5 KB
Other1 file · 7.8 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights11.9 GB e08653b946b7
config.jsonConfiguration12.0 KB —
generation_config.jsonConfiguration164 B —
processor_config.jsonConfiguration1.3 KB —
recipe.yamlConfiguration7.2 KB —
README.mdDocumentation11.5 KB —
chat_template.jinjaOther7.8 KB —
.gitattributesRepository1.6 KB —
tokenizer.jsonTokenizer20.0 MB 87a7830d63fc
tokenizer_config.jsonTokenizer1.2 KB —

License and Download

License
other
Access
Open weights, no gate
Download size
11.9 GB
Download from Hao Liang

Released by Hao Liang through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published11.9 GB
16-bit18.8 GB
8-bit9.4 GB
4-bit4.7 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Omni-Edu-9B-FP8

How much GPU memory does Omni-Edu-9B-FP8 need?

About 22.6 GB at 16-bit and 5.6 GB at 4-bit: the weights (9.4B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Omni-Edu-9B-FP8 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Omni-Edu-9B-FP8 released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Omni-Edu-9B-FP8's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Image and text to text

Qwen-Image-2.1-PE-I2I-Heretic

Darrellbest

The image-editing prompt rewriter for Qwen-Image-2.1, a fine-tuned Qwen3.5-VL 9B that turns a short edit instruction plus 1–N input images into a detailed English edit prompt, with its refusal behaviour removed by Heretic directional ablation. bf16, same shapes and parameter count as the source; nothing else was changed. systemprompt.txt is included and required. It defines the output format. It is the unmodified file from the source repo. The second row is an independent evaluation of the exported weights with Heretic's evaluatemodel. Refusals were measured on mlabonne/harmfulbehaviors and KL divergence (damage to ordinary behaviour, first-token distributions) on mlabonne/harmlessalpaca…

Open weights other 9.4B parameters 262,144 tokens

Model · Image and text to text

LucidVitality-9b

Matthew Andrews

LucidVitality-9B is a little goer. It's a roleplay or creative focused merge of two Qwen3.5 9b variants for people with absolute potatoes, like myself. It marries the improved prose of Darkhn's Qwen3.5-9B-Animus-V13.0 with the lower looping, higher EOS exit, and slightly more coherency (compared to base) from Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED of DavidAU's making. I haven't merged anything for a long time, as it's been a hard time for finetuning. They rarely increase prose quality, often deeply lose intelligence over base (even when tuned for intelligence or agentic). Base model's getting tough to beat. So it was a pleasant surprise to find two models that each…

Open weights 9.4B parameters 262,144 tokens transformers

Model · Image and text to text

GameScaling-9B-S3

Tsinghua Spatial Intelligence Lab

This repository: GameScaling-9B-S3. Qwen3.5-9B continued pre-trained on a balanced mixture of 27% Minecraft and other games (S3), 1,600 h of gameplay, 6,760 training steps; 18.8 GB of bfloat16 weights on 1 GPU. Serve it with bash scripts/servevllm.sh THUSI-Lab/GameScaling-9B-S3 8000 (§1). The inference client, prompts and scripts are in THUSI-Lab/GameScaling; all eight checkpoints are in the GameScaling models are Qwen3.5 vision-language models with continued pre-training on keyboard-and-mouse gameplay. Each call takes the current game frame (plus a short history of past frames and actions) and returns the next 200 ms of keyboard and mouse actions: 6 steps of 33 ms each, plus one mouse…

Open weights apache-2.0 9.4B parameters 262,144 tokens transformers

Model · Image and text to text

GameScaling-9B-S1

Tsinghua Spatial Intelligence Lab

This repository: GameScaling-9B-S1. Qwen3.5-9B continued pre-trained on Minecraft gameplay only (S1), 1,600 h of gameplay, 6,736 training steps; 18.8 GB of bfloat16 weights on 1 GPU. Serve it with bash scripts/servevllm.sh THUSI-Lab/GameScaling-9B-S1 8000 (§1). The inference client, prompts and scripts are in THUSI-Lab/GameScaling; all eight checkpoints are in the GameScaling models are Qwen3.5 vision-language models with continued pre-training on keyboard-and-mouse gameplay. Each call takes the current game frame (plus a short history of past frames and actions) and returns the next 200 ms of keyboard and mouse actions: 6 steps of 33 ms each, plus one mouse movement and scroll for the…

Open weights apache-2.0 9.4B parameters 262,144 tokens transformers

Model · Image and text to text

blink-mimo-9b

Govind Kamtamneni

Send a text or JSON state and your questions: choice picks from up to 255 options, noul is yes/no, and score takes 2–10 ordered levels. Each question gets probabilities over its offered options from one forward pass, with no generated text. Long or large multi-question requests may use several batches. Personal research release by thegovind, not an official product of any company. No affiliation with TypeSafe AI, Xiaomi, Alibaba Cloud or the Qwen team. Weights are for non-commercial research; see Licence. We ran the full Decision Index 0.2 suite ourselves with the official scoring kit at commit 19ad28e on 2026-09-25. This is a descriptive run, not a leaderboard submission or accepted…

Open weights other 9.4B parameters 262,144 tokens transformers

Model · Image and text to text

Vinci-Bozza-1.0

SimpleDirect

Vinci Bozza is a 9-billion-parameter open-weight model, fine-tuned from Qwen 3.5-9B with SimpleDirect's Constitution and character training. It is a disposition tune, not a capability retrain. We did not try to make the base model smarter. We tried to make it more honest — and then we measured what that cost. Safer and more honest on the measures below, with general knowledge holding. Strict instruction-following, tool abstention and multi-turn task-holding paid for it. All of it is below, at the same prominence as the gains. The rows above are configuration and artifact values read out of this repository, not validated results. A context length in a config file is a limit the model will…

Open weights apache-2.0 9.4B parameters 262,144 tokens transformers