SAVRN
Search Contact SAVRN

Open-weight model · Image to text

NuExtract3

by NuMind numind/NuExtract3

NuExtract3 is a unified 4B vision-language reasoning model for document understanding.

Parameters4.5B
Context262,144
Weights9.3 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads65.6k

Runs On

What it takes to serve NuExtract3 (4.5B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 9.1 GB 10.9 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 4.5 GB 5.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 2.3 GB 2.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By NuMind, published under apache-2.0, revision c99dc8f5641b.

API / Platform   |    Blog   |    Discord   |    GitHub

NuExtract3 is a unified 4B vision-language reasoning model for document understanding.

It combines strong structured information extraction with high-quality image-to-Markdown conversion, making it suitable for extraction pipelines, OCR, and RAG preprocessing for all types of documents such as scans, receipts, forms, invoices, contracts or tables.

Try it out in the space!

Overview

  • Structured extraction: input (text/images) + JSON template + instructions --> JSON output
  • Markdown conversion: input (text/images) --> Markdown
  • Multimodal inputs: text, images, or text + images.
  • Multilingual documents.
  • Reasoning and non-reasoning inference modes.
  • Template generation for structured extraction from natural language or input document.

Benchmark results

Structured Extraction

Read the full model card (2,355 words)

Configuration

Architecture
Qwen3_5ForConditionalGeneration
Context length (tokens)
262,144
Layers
32
Hidden size
2,560
Feed-forward size
9,216
Attention heads
16
Key/value heads
4
Head dimension
256
Vocabulary size
248,320
Model type
qwen3_5

Identity and Version

Repository
numind/NuExtract3
Publisher
NuMind
Task
Image to text
Modality
Image and text
Library
transformers
Parameters
4.5B parameters
Languages
vlm, ocr, rag
Revision
c99dc8f5641b866aa0192b6ea78f84bf9f3535f1
First published
2026-04-29
Last updated
2026-08-20

Files and Weights

29 files, 9.3 GB in total. The weights are 2 files totalling 9.3 GB in safetensors.

Weights2 files · 9.3 GB
Configuration6 files · 62.6 KB
Tokenizer2 files · 20.0 MB
Documentation3 files · 40.9 KB
Other15 files · 3.6 MB
Repository1 file · 2.2 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights9.1 GB aca0a9d61da5
model_mtp.safetensorsWeights241.2 MB 7f993d7b896c
.eval_results/extractbench.yamlConfiguration1.6 KB
.eval_results/olmocrbench.yamlConfiguration502 B
config.jsonConfiguration2.9 KB
generation_config.jsonConfiguration115 B
model.safetensors.index.jsonConfiguration56.3 KB
processor_config.jsonConfiguration1.2 KB
LICENSEDocumentation11.3 KB
README.mdDocumentation25.5 KB
TYPES.mdDocumentation4.1 KB
chat_template.jinjaOther6.8 KB
extraction_performance_no_thinking.pngOther257.4 KB 873703147b4a
extraction_performance_thinking.pngOther293.5 KB cc50cef0718e
header.svgOther110.4 KB
logo.pngOther1.1 MB eacf669413cc
logo_nuextract.svgOther8.9 KB
markdown.pngOther1.1 MB b898b030d41e
markdown_base.pngOther166.2 KB 0475336139bd
markdown_reasoning.pngOther161.5 KB 733f46ad4c82
md2st.svgOther88.6 KB
ocr_benchmark_specialized.pngOther227.6 KB 7c6e21084c03
ocr_preferences.svgOther71.2 KB
st.svgOther39.7 KB
task_instructions_markdown.txtOther2.7 KB
task_instructions_structured.txtOther11.0 KB
.gitattributesRepository2.2 KB
tokenizer.jsonTokenizer20.0 MB 87a7830d63fc
tokenizer_config.jsonTokenizer1.2 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
9.3 GB
Download from NuMind

Released by NuMind through its official repository on Hugging Face. Read the license.

Built From

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
allenai/olmOCR-bench Task old_scansMetric old_scansSetup old_scans.jsonl sub-score (present/absent/order); markdown mode, non-thinking, greedy, 170 DPI. NuExtract3 leads the field on present (41.6) — see source for the full sub-score breakdown.Comparison conditions not established 37.8 ocr-bench — old_scans multi-model comparison
Reported by a third party
Evaluated revision not stated 2026-06-27
llamaindex/ExtractBench Task longMetric longSetup Pipeline name: nuextract3_extract; served checkpoint numind/NuExtract3 on vLLM, one-shot template-guided extraction (the JSON Schema is converted to a NuExtract template)Comparison conditions not established 37.72 ExtractBench
Reported by a third party
Evaluated revision not stated 2026-08-20
llamaindex/ExtractBench Task meanMetric meanSetup Pipeline name: nuextract3_extract; served checkpoint numind/NuExtract3 on vLLM, one-shot template-guided extraction (the JSON Schema is converted to a NuExtract template)Comparison conditions not established 82.35 ExtractBench
Reported by a third party
Evaluated revision not stated 2026-08-20
llamaindex/ExtractBench Task mediumMetric mediumSetup Pipeline name: nuextract3_extract; served checkpoint numind/NuExtract3 on vLLM, one-shot template-guided extraction (the JSON Schema is converted to a NuExtract template)Comparison conditions not established 76.76 ExtractBench
Reported by a third party
Evaluated revision not stated 2026-08-20
llamaindex/ExtractBench Task shortMetric shortSetup Pipeline name: nuextract3_extract; served checkpoint numind/NuExtract3 on vLLM, one-shot template-guided extraction (the JSON Schema is converted to a NuExtract template)Comparison conditions not established 88.06 ExtractBench
Reported by a third party
Evaluated revision not stated 2026-08-20

Memory Requirements

PrecisionWeights in memory
As published9.3 GB
16-bit9.1 GB
8-bit4.5 GB
4-bit2.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About NuExtract3

How much GPU memory does NuExtract3 need?

About 10.9 GB at 16-bit and 2.7 GB at 4-bit: the weights (4.5B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run NuExtract3 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use NuExtract3 commercially?

Yes. NuExtract3 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is NuExtract3's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

This is an NVFP4 quantized version of Qwen3-VL-8B-Instruct, a powerful vision-language model for multimodal understanding and generation tasks. The following modules were excluded from quantization to maintain model quality: - lmhead (language model head) - Visual encoder modules (model.visual.) - MLP gate projections (.mlp.gate$) For faster inference, you can use this model with vLLM: This quantized model maintains high quality for vision-language tasks while significantly reducing memory usage. The SmoothQuant technique helps preserve model accuracy during quantization. Typical quality degradation is 2-5% compared to the full-precision model. 1. Calibration: Used 512 samples from the…

Open weights apache-2.0 5.7B parameters 262,144 tokens

Model · Image to text

granite-vision-3.3-2b

IBM Granite

Granite-vision-3.3-2b is a compact and efficient vision-language model, specifically designed for visual document understanding, enabling automated content extraction from tables, charts, infographics, plots, diagrams, and more. Granite-vision-3.3-2b introduces several novel experimental features such as image segmentation, doctags generation, and multi-page support (see Experimental Capabilities for more details) and offers enhanced safety when compared to earlier Granite vision models. The model was trained on a meticulously curated instruction-following data, comprising diverse public and synthetic datasets tailored to support a wide range of document understanding and general image…

Open weights apache-2.0 3B parameters 131,072 tokens

Model · Image to text

kosmos-2-patch14-224

Microsoft

This Hub repository contains a HuggingFace's transformers implementation of the original Kosmos-2 model from Microsoft. Use the code below to get started with the model. This model is capable of performing different tasks through changing the prompts. First, let's define a function to run a prompt. Here are the tasks Kosmos-2 could perform: Once you have the entities, you can use the following helper function to draw their bounding bboxes on the image

Open weights mit 1.7B parameters 2,048 tokens transformers

Model · Image to text

GLM-OCR

Z.ai

Join our WeChat and Discord community Use GLM-OCR's API GLM-OCR is a multimodal OCR model for complex document understanding, built on the GLM-V encoder–decoder architecture. It introduces Multi-Token Prediction (MTP) loss and stable full-task reinforcement learning to improve training efficiency, recognition accuracy, and generalization. The model integrates the CogViT visual encoder pre-trained on large-scale image–text data, a lightweight cross-modal connector with efficient token downsampling, and a GLM-0.5B language decoder. Combined with a two-stage pipeline of layout analysis and parallel recognition based on PP-DocLayout-V3, GLM-OCR delivers robust and high-quality OCR performance…

Open weights mit 1.3B parameters 131,072 tokens transformers

Model · Image to text

GLM-OCR

Unsloth AI

Join our WeChat and Discord community Use GLM-OCR's API GLM-OCR is a multimodal OCR model for complex document understanding, built on the GLM-V encoder–decoder architecture. It introduces Multi-Token Prediction (MTP) loss and stable full-task reinforcement learning to improve training efficiency, recognition accuracy, and generalization. The model integrates the CogViT visual encoder pre-trained on large-scale image–text data, a lightweight cross-modal connector with efficient token downsampling, and a GLM-0.5B language decoder. Combined with a two-stage pipeline of layout analysis and parallel recognition based on PP-DocLayout-V3, GLM-OCR delivers robust and high-quality OCR performance…

Open weights mit 1.3B parameters 131,072 tokens transformers

Model · Image to text

LightOnOCR-1B-1025

LightOn AI

Full BF16 version of the model. We recommend this variant for inference and further fine-tuning. LightOnOCR-1B is a compact, end-to-end vision–language model for Optical Character Recognition (OCR) and document understanding. It achieves state-of-the-art accuracy in its weight class while being several times faster and cheaper than larger general-purpose VLMs. Highlights LightOnOCR combines a Vision Transformer encoder(Pixtral-based) with a lightweight text decoder(Qwen3-based) distilled from high-quality open VLMs. It is optimized for document parsing tasks, producing accurate, layout-aware text extraction from high-resolution pages. All benchmarks evaluated using vLLM on the Olmo-Bench.…

Open weights apache-2.0 1.2B parameters 8,192 tokens transformers