This is the FP8 mixed-precision quantization of HiDream-O1-Image for use with ComfyUI.
Runs On
What it takes to serve HiDream-O1-Image-FP8 (8.8B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 17.6 GB | 21.1 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 8.8 GB | 10.6 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 4.4 GB | 5.3 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.
Model Card
By DRBAPH, published under mit, revision f554d59dba6b.
This is the FP8 mixed-precision quantization of HiDream-O1-Image for use with ComfyUI. By quantizing to 8-bit floats, the model fits comfortably within ~10 GB of VRAM — making it accessible on 12 GB GPUs (RTX 3080/4070/4080, etc.) with minimal quality trade-off. This is the recommended variant for GPUs with less than 16 GB VRAM. Tested on 12 GB cards at 2048 × 2048 resolution. Or install via ComfyUI Manager by searching for HiDream O1. Open ComfyUI and use the workflow provided in the custom node repository. Point the model loader to HiDream-O1-Image-fp8. HiDream-O1-Image is a natively unified image generative foundation model built on a Pixel-level Unified Transformer (UiT) — no external…
Read DRBAPH's full model card
HiDream-O1-Image — FP8 Mixed (ComfyUI)
This is the FP8 mixed-precision quantization of HiDream-O1-Image for use with ComfyUI. By quantizing to 8-bit floats, the model fits comfortably within ~10 GB of VRAM — making it accessible on 12 GB GPUs (RTX 3080/4070/4080, etc.) with minimal quality trade-off.
Custom ComfyUI Node: Saganaki22/HiDream_O1-ComfyUI
VRAM Requirements
| Precision | Approximate VRAM |
|---|---|
| BF16 | 17 – 20 GB |
| FP16 | 17 – 20 GB |
| FP8 Mixed (this repo) | ~10 GB |
This is the recommended variant for GPUs with less than 16 GB VRAM. Tested on 12 GB cards at 2048 × 2048 resolution.
What is FP8 Mixed? Weights are stored in
float8_e4m3fnformat. Sensitive layers (norms, embeddings, output heads) retain higher precision to preserve stability, hence "mixed." On CUDA-capable GPUs with Hopper or Ada Lovelace architecture (RTX 40xx, H100), FP8 compute is hardware-accelerated. On older GPUs, weights are dequantized on-the-fly — still saving VRAM, with a small speed penalty.
Quick Start — ComfyUI
1. Install the Custom Node
cd ComfyUI/custom_nodes
git clone https://github.com/Saganaki22/HiDream_O1-ComfyUI
pip install -r HiDream_O1-ComfyUI/requirements.txt
Or install via ComfyUI Manager by searching for HiDream O1.
2. Download the Weights
huggingface-cli download drbaph/HiDream-O1-Image-FP8 \
--local-dir ComfyUI/models/diffusion_models/HiDream-O1-Image-fp8
3. Load in ComfyUI
Open ComfyUI and use the workflow provided in the custom node repository. Point the model loader to HiDream-O1-Image-fp8.
About HiDream-O1-Image
HiDream-O1-Image is a natively unified image generative foundation model built on a Pixel-level Unified Transformer (UiT) — no external VAEs, no disjoint text encoders. It encodes raw pixels, text, and task-specific conditions in a single shared token space, supporting:
- Text-to-image generation up to 2,048 × 2,048
- Instruction-based image editing
- Subject-driven personalization (multi-reference IP)
- Long-text and multilingual text rendering
At only 9B parameters it matches or exceeds much larger open-source DiTs and leading closed-source models. It debuted at #8 in the Artificial Analysis Text to Image Arena (2026-05-05).
Key Features
- Pixel-Level Unified Transformer — end-to-end on raw pixels, no VAE, no disjoint text encoder
- One Model, Many Tasks — T2I, editing, personalization, storyboard generation
- Reasoning-Driven Prompt Agent — built-in "thinking" agent that resolves layout and rendering before generation
- Native High Resolution — direct synthesis up to 2,048 × 2,048
- 9B Parameters — performance parity with models many times larger
- FP8 Quantized — ~half the VRAM of full-precision variants, minimal quality loss
Model Variants
| Repo | Precision | VRAM | Inference Steps |
|---|---|---|---|
| drbaph/HiDream-O1-Image-BF16 | BF16 | 17–20 GB | 50 |
| drbaph/HiDream-O1-Image-FP16 | FP16 | 17–20 GB | 50 |
| drbaph/HiDream-O1-Image-FP8 (this repo) | FP8 Mixed | ~10 GB | 50 |
| HiDream-ai/HiDream-O1-Image | Original | — | 50 |
| HiDream-ai/HiDream-O1-Image-Dev | Original Dev | — | 28 |
Benchmark Results (from original model)
GenEval (compositional generation) — HiDream-O1-Image scores 0.90 overall at 9B params, second only to the 200B+ Pro variant and ahead of GPT Image 2 (0.89).
DPG-Bench (dense prompt alignment) — Overall score 89.83, ranking second behind the Pro variant.
HPSv3 (human preference) — Overall score 10.37, outperforming GPT Image 2 (10.21) and Nano Banana 2.0 (10.01).
License
The original HiDream-O1-Image model and code are released under the MIT License. This FP8 quantization inherits the same license.
Links
- Original model:HiDream-ai/HiDream-O1-Image
- ComfyUI node:Saganaki22/HiDream_O1-ComfyUI
- Technical report:HiDream-O1-Image.pdf
- Online demo:HiDream-O1-Image Space
Configuration
- Architecture
- Qwen3VLForConditionalGeneration
- Context length (tokens)
- 262,144
- Layers
- 36
- Hidden size
- 4,096
- Feed-forward size
- 12,288
- Attention heads
- 32
- Key/value heads
- 8
- Head dimension
- 128
- Vocabulary size
- 151,936
- RoPE base
- 5,000,000
- Model type
- qwen3_vl
Identity and Version
- Repository
- drbaph/HiDream-O1-Image-FP8
- Publisher
- DRBAPH
- Task
- Image text to image
- Modality
- Other
- Library
- diffusers
- Parameters
- 8.8B parameters
- Languages
- en, zh
- Revision
- f554d59dba6bc536309f95ae152ca92321e14702
- First published
- 2026-05-09
- Last updated
- 2026-05-10
Files and Weights
15 files, 8.8 GB in total. The weights are 1 file totalling 8.8 GB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors | Weights | 8.8 GB | f212b6ec25fd |
| chat_template.json | Configuration | 5.5 KB | — |
| config.json | Configuration | 1.6 KB | — |
| generation_config.json | Configuration | 269 B | — |
| preprocessor_config.json | Configuration | 390 B | — |
| README.md | Documentation | 5.2 KB | — |
| assets/IP.webp | Other | 2.6 MB | 9dc8f61b5e7c |
| assets/general.webp | Other | 5.6 MB | 32a93bb7f0aa |
| assets/leaderboard.png | Other | 546.2 KB | 944224dc8b9e |
| assets/text-layout.webp | Other | 5.5 MB | f12b57ab3528 |
| .gitattributes | Repository | 1.7 KB | — |
| merges.txt | Tokenizer | 1.7 MB | — |
| tokenizer.json | Tokenizer | 7.0 MB | — |
| tokenizer_config.json | Tokenizer | 11.0 KB | — |
| vocab.json | Tokenizer | 2.8 MB | — |
License and Download
- License
- mit
- Access
- Open weights, no gate
- Download size
- 8.8 GB
Released by DRBAPH through its official repository on Hugging Face. Read the license.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 8.8 GB |
| 16-bit | 17.6 GB |
| 8-bit | 8.8 GB |
| 4-bit | 4.4 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About HiDream-O1-Image-FP8
How much GPU memory does HiDream-O1-Image-FP8 need?
About 21.1 GB at 16-bit and 5.3 GB at 4-bit: the weights (8.8B parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run HiDream-O1-Image-FP8 on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use HiDream-O1-Image-FP8 commercially?
Yes. HiDream-O1-Image-FP8 is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.
What is HiDream-O1-Image-FP8's context length?
262,144 tokens, from the maximum position embeddings in its published configuration.