SAVRN
Search Contact SAVRN

Open-weight model · Image text to image

HiDream-O1-Image-FP8

by DRBAPH drbaph/HiDream-O1-Image-FP8

This is the FP8 mixed-precision quantization of HiDream-O1-Image for use with ComfyUI.

Parameters8.8B
Context262,144
Weights8.8 GB
Licensemit
AccessOpen weights
Monthly Downloads103.3k

Runs On

What it takes to serve HiDream-O1-Image-FP8 (8.8B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 17.6 GB 21.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 8.8 GB 10.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.4 GB 5.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By DRBAPH, published under mit, revision f554d59dba6b.

This is the FP8 mixed-precision quantization of HiDream-O1-Image for use with ComfyUI. By quantizing to 8-bit floats, the model fits comfortably within ~10 GB of VRAM — making it accessible on 12 GB GPUs (RTX 3080/4070/4080, etc.) with minimal quality trade-off. This is the recommended variant for GPUs with less than 16 GB VRAM. Tested on 12 GB cards at 2048 × 2048 resolution. Or install via ComfyUI Manager by searching for HiDream O1. Open ComfyUI and use the workflow provided in the custom node repository. Point the model loader to HiDream-O1-Image-fp8. HiDream-O1-Image is a natively unified image generative foundation model built on a Pixel-level Unified Transformer (UiT) — no external…

Read DRBAPH's full model card

HiDream-O1-Image — FP8 Mixed (ComfyUI)

This is the FP8 mixed-precision quantization of HiDream-O1-Image for use with ComfyUI. By quantizing to 8-bit floats, the model fits comfortably within ~10 GB of VRAM — making it accessible on 12 GB GPUs (RTX 3080/4070/4080, etc.) with minimal quality trade-off.

Custom ComfyUI Node: Saganaki22/HiDream_O1-ComfyUI


VRAM Requirements

Precision Approximate VRAM
BF16 17 – 20 GB
FP16 17 – 20 GB
FP8 Mixed (this repo) ~10 GB

This is the recommended variant for GPUs with less than 16 GB VRAM. Tested on 12 GB cards at 2048 × 2048 resolution.

What is FP8 Mixed? Weights are stored in float8_e4m3fn format. Sensitive layers (norms, embeddings, output heads) retain higher precision to preserve stability, hence "mixed." On CUDA-capable GPUs with Hopper or Ada Lovelace architecture (RTX 40xx, H100), FP8 compute is hardware-accelerated. On older GPUs, weights are dequantized on-the-fly — still saving VRAM, with a small speed penalty.


Quick Start — ComfyUI

1. Install the Custom Node

cd ComfyUI/custom_nodes
git clone https://github.com/Saganaki22/HiDream_O1-ComfyUI
pip install -r HiDream_O1-ComfyUI/requirements.txt

Or install via ComfyUI Manager by searching for HiDream O1.

2. Download the Weights

huggingface-cli download drbaph/HiDream-O1-Image-FP8 \
    --local-dir ComfyUI/models/diffusion_models/HiDream-O1-Image-fp8

3. Load in ComfyUI

Open ComfyUI and use the workflow provided in the custom node repository. Point the model loader to HiDream-O1-Image-fp8.


About HiDream-O1-Image

HiDream-O1-Image is a natively unified image generative foundation model built on a Pixel-level Unified Transformer (UiT) — no external VAEs, no disjoint text encoders. It encodes raw pixels, text, and task-specific conditions in a single shared token space, supporting:

  • Text-to-image generation up to 2,048 × 2,048
  • Instruction-based image editing
  • Subject-driven personalization (multi-reference IP)
  • Long-text and multilingual text rendering

At only 9B parameters it matches or exceeds much larger open-source DiTs and leading closed-source models. It debuted at #8 in the Artificial Analysis Text to Image Arena (2026-05-05).


Key Features

  • Pixel-Level Unified Transformer — end-to-end on raw pixels, no VAE, no disjoint text encoder
  • One Model, Many Tasks — T2I, editing, personalization, storyboard generation
  • Reasoning-Driven Prompt Agent — built-in "thinking" agent that resolves layout and rendering before generation
  • Native High Resolution — direct synthesis up to 2,048 × 2,048
  • 9B Parameters — performance parity with models many times larger
  • FP8 Quantized — ~half the VRAM of full-precision variants, minimal quality loss

Model Variants

Repo Precision VRAM Inference Steps
drbaph/HiDream-O1-Image-BF16 BF16 17–20 GB 50
drbaph/HiDream-O1-Image-FP16 FP16 17–20 GB 50
drbaph/HiDream-O1-Image-FP8 (this repo) FP8 Mixed ~10 GB 50
HiDream-ai/HiDream-O1-Image Original 50
HiDream-ai/HiDream-O1-Image-Dev Original Dev 28

Benchmark Results (from original model)

GenEval (compositional generation) — HiDream-O1-Image scores 0.90 overall at 9B params, second only to the 200B+ Pro variant and ahead of GPT Image 2 (0.89).

DPG-Bench (dense prompt alignment) — Overall score 89.83, ranking second behind the Pro variant.

HPSv3 (human preference) — Overall score 10.37, outperforming GPT Image 2 (10.21) and Nano Banana 2.0 (10.01).


License

The original HiDream-O1-Image model and code are released under the MIT License. This FP8 quantization inherits the same license.


Links

Configuration

Architecture
Qwen3VLForConditionalGeneration
Context length (tokens)
262,144
Layers
36
Hidden size
4,096
Feed-forward size
12,288
Attention heads
32
Key/value heads
8
Head dimension
128
Vocabulary size
151,936
RoPE base
5,000,000
Model type
qwen3_vl

Identity and Version

Repository
drbaph/HiDream-O1-Image-FP8
Publisher
DRBAPH
Task
Image text to image
Modality
Other
Library
diffusers
Parameters
8.8B parameters
Languages
en, zh
Revision
f554d59dba6bc536309f95ae152ca92321e14702
First published
2026-05-09
Last updated
2026-05-10

Files and Weights

15 files, 8.8 GB in total. The weights are 1 file totalling 8.8 GB in safetensors.

Weights1 file · 8.8 GB
Configuration4 files · 7.7 KB
Tokenizer4 files · 11.5 MB
Documentation1 file · 5.2 KB
Other4 files · 14.2 MB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights8.8 GB f212b6ec25fd
chat_template.jsonConfiguration5.5 KB
config.jsonConfiguration1.6 KB
generation_config.jsonConfiguration269 B
preprocessor_config.jsonConfiguration390 B
README.mdDocumentation5.2 KB
assets/IP.webpOther2.6 MB 9dc8f61b5e7c
assets/general.webpOther5.6 MB 32a93bb7f0aa
assets/leaderboard.pngOther546.2 KB 944224dc8b9e
assets/text-layout.webpOther5.5 MB f12b57ab3528
.gitattributesRepository1.7 KB
merges.txtTokenizer1.7 MB
tokenizer.jsonTokenizer7.0 MB
tokenizer_config.jsonTokenizer11.0 KB
vocab.jsonTokenizer2.8 MB

License and Download

License
mit
Access
Open weights, no gate
Download size
8.8 GB
Download from DRBAPH

Released by DRBAPH through its official repository on Hugging Face. Read the license.

Memory Requirements

PrecisionWeights in memory
As published8.8 GB
16-bit17.6 GB
8-bit8.8 GB
4-bit4.4 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About HiDream-O1-Image-FP8

How much GPU memory does HiDream-O1-Image-FP8 need?

About 21.1 GB at 16-bit and 5.3 GB at 4-bit: the weights (8.8B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run HiDream-O1-Image-FP8 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use HiDream-O1-Image-FP8 commercially?

Yes. HiDream-O1-Image-FP8 is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

What is HiDream-O1-Image-FP8's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.