SAVRN
Search Contact SAVRN

Open-weight model · Any to any

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

by NVIDIA nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows.

Parameters33B
Context262,144
Weights66.0 GB
Licenseother
AccessOpen weights
Monthly Downloads281.6k

Runs On

What it takes to serve Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 (33B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 66.0 GB 79.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 33.0 GB 39.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 16.5 GB 19.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows. It extends the Nemotron Nano family with integrated video+speech comprehension, Graphical User Interface (GUI), Optical Character Recognition (OCR), and speech transcription capabilities, enabling end-to-end processing of rich enterprise content such as meeting recordings, M&E assets, training videos, and complex business documents. NVIDIA Nemotron 3 Nano Omni was developed by NVIDIA as part of the Nemotron model family. This model is available for commercial use. This…

Excerpt from the card by NVIDIA, licensed other.

Configuration

Architecture
NemotronH_Nano_Omni_Reasoning_V3
Context length (tokens)
262,144
Layers
52
Hidden size
2,688
Feed-forward size
1,856
Attention heads
32
Key/value heads
2
Head dimension
128
Vocabulary size
131,072
Routed experts
128
Experts active per token
6
RoPE base
10,000
Stored precision
bfloat16
Model type
NemotronH_Nano_Omni_Reasoning_V3

Identity and Version

Repository
nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16
Publisher
NVIDIA
Task
Any to any
Modality
Multimodal
Library
transformers
Parameters
33B parameters
Languages
Not stated by the source
Revision
e5e9932441de940c9a62185c870ea5bcd4cd24e2
First published
2026-04-20
Last updated
2026-08-24

Files and Weights

50 files, 66.1 GB in total. The weights are 17 files totalling 66.0 GB in safetensors.

Weights17 files · 66.0 GB
Configuration18 files · 1.0 MB
Tokenizer2 files · 17.3 MB
Documentation5 files · 59.4 KB
Other7 files · 8.4 MB
Repository1 file · 1.8 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00017.safetensorsWeights4.0 GB de952574c918
model-00002-of-00017.safetensorsWeights4.0 GB 5b2707cbe0e3
model-00003-of-00017.safetensorsWeights4.0 GB f315ecba2cd3
model-00004-of-00017.safetensorsWeights4.0 GB 253fbbe376a8
model-00005-of-00017.safetensorsWeights4.0 GB 3c025df3ffea
model-00006-of-00017.safetensorsWeights4.0 GB 24a7ba72f08e
model-00007-of-00017.safetensorsWeights4.0 GB 071fd79ae9d1
model-00008-of-00017.safetensorsWeights4.0 GB 307f0422e80c
model-00009-of-00017.safetensorsWeights4.0 GB b07c93f94210
model-00010-of-00017.safetensorsWeights4.0 GB 4eb2ae5f5c91
model-00011-of-00017.safetensorsWeights4.0 GB aa28bbab8680
model-00012-of-00017.safetensorsWeights4.0 GB 1804bf9755ee
model-00013-of-00017.safetensorsWeights4.0 GB 78c70bebd7a0
model-00014-of-00017.safetensorsWeights4.0 GB 8261526b0941
model-00015-of-00017.safetensorsWeights4.0 GB 442006b0a48b
model-00016-of-00017.safetensorsWeights4.0 GB bc699ab1095f
model-00017-of-00017.safetensorsWeights2.1 GB d34d8b0e21f5
__init__.pyConfiguration
audio_model.pyConfiguration6.9 KB
config.jsonConfiguration9.8 KB
configuration.pyConfiguration4.9 KB
configuration_nemotron_h.pyConfiguration14.0 KB
configuration_radio.pyConfiguration9.0 KB
evs.pyConfiguration2.9 KB
generation_config.jsonConfiguration309 B
image_processing.pyConfiguration10.9 KB
model.safetensors.index.jsonConfiguration819.1 KB
modeling.pyConfiguration28.7 KB
modeling_nemotron_h.pyConfiguration64.3 KB
preprocessor_config.jsonConfiguration594 B
processing.pyConfiguration26.3 KB
processing_utils.pyConfiguration3.0 KB
special_tokens_map.jsonConfiguration420 B
video_io.pyConfiguration6.5 KB
video_processing.pyConfiguration6.5 KB
README.mdDocumentation48.2 KB
bias.mdDocumentation2.7 KB
explainability.mdDocumentation4.8 KB
privacy.mdDocumentation845 B
safety.mdDocumentation2.8 KB
chat_template.jinjaOther14.3 KB
media/2414-165385-0000.wavOther638.8 KB d522710e8454
media/demo.mp4Other7.3 MB e77cbba79609
media/example1a.jpegOther14.9 KB 586882a9536e
media/example1b.jpegOther12.1 KB c309f327d352
media/table.pngOther131.0 KB 001461d8dd27
media/tech.pngOther222.1 KB 4ae75f51f941
.gitattributesRepository1.8 KB
tokenizer.jsonTokenizer17.1 MB e5e7dc84d72e
tokenizer_config.jsonTokenizer188.0 KB

License and Download

License
other
Access
Open weights, no gate
Download size
66.0 GB
Download from NVIDIA

Released by NVIDIA through its official repository on Hugging Face.

Built From

  • Described by arXiv:2604.24954
  • Trained on (disclosed) nvidia/Nemotron-Image-Training-v3

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
llamaindex/ParseBench Task chartMetric chartSetup Pipeline name: nemotron_omni_30b_vllm_thinkingComparison conditions not established 31.47 ParseBench
Reported by a third party
Evaluated revision not stated 2026-07-27
llamaindex/ParseBench Task layoutMetric layoutSetup Pipeline name: nemotron_omni_30b_vllm_thinkingComparison conditions not established 0 ParseBench
Reported by a third party
Evaluated revision not stated 2026-07-27
llamaindex/ParseBench Task meanMetric meanSetup Pipeline name: nemotron_omni_30b_vllm_thinkingComparison conditions not established 48.51 ParseBench
Reported by a third party
Evaluated revision not stated 2026-07-27
llamaindex/ParseBench Task tableMetric tableSetup Pipeline name: nemotron_omni_30b_vllm_thinkingComparison conditions not established 70.44 ParseBench
Reported by a third party
Evaluated revision not stated 2026-07-27
llamaindex/ParseBench Task text_contentMetric text_contentSetup Pipeline name: nemotron_omni_30b_vllm_thinkingComparison conditions not established 80.97 ParseBench
Reported by a third party
Evaluated revision not stated 2026-07-27
llamaindex/ParseBench Task text_formattingMetric text_formattingSetup Pipeline name: nemotron_omni_30b_vllm_thinkingComparison conditions not established 59.69 ParseBench
Reported by a third party
Evaluated revision not stated 2026-07-27

Memory Requirements

PrecisionWeights in memory
As published66.0 GB
16-bit66.0 GB
8-bit33.0 GB
4-bit16.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Questions About Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

How much GPU memory does Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 need?

About 79.2 GB at 16-bit and 19.8 GB at 4-bit: the weights (33B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows. It extends the Nemotron Nano family with integrated video+speech comprehension, Graphical User Interface (GUI), Optical Character Recognition (OCR), and speech transcription capabilities, enabling end-to-end processing of rich enterprise content such as meeting recordings, M&E assets, training videos, and complex business documents. NVIDIA Nemotron 3 Nano Omni was developed by NVIDIA as part of the Nemotron model family. This model is available for commercial use. This…

Open weights other 33B parameters 262,144 tokens transformers

Model · Any to any

Qwen3-Omni-30B-A3B-Thinking

Qwen

Qwen3-Omni is the natively end-to-end multilingual omni-modal foundation models. It processes text, images, audio, and video, and delivers real-time streaming responses in both text and natural speech. We introduce several architectural upgrades to improve performance and efficiency. Key features: Qwen3-Omni supports a wide range of multimodal application scenarios, covering various domain tasks involving audio, image, video, and audio-visual modalities. Below are several cookbooks demonstrating the usage cases of Qwen3-Omni and these cookbooks include our actual execution logs. You can first follow the QuickStart guide to download the model and install the necessary inference environment…

Open weights other 31.7B parameters transformers

Model · Any to any

Qwen3-Omni-30B-A3B-Instruct

Qwen

Qwen3-Omni is the natively end-to-end multilingual omni-modal foundation models. It processes text, images, audio, and video, and delivers real-time streaming responses in both text and natural speech. We introduce several architectural upgrades to improve performance and efficiency. Key features: Qwen3-Omni supports a wide range of multimodal application scenarios, covering various domain tasks involving audio, image, video, and audio-visual modalities. Below are several cookbooks demonstrating the usage cases of Qwen3-Omni and these cookbooks include our actual execution logs. You can first follow the QuickStart guide to download the model and install the necessary inference environment…

Open weights other 35.3B parameters transformers

Model · Any to any

Qwen3-Omni-30B-A3B-FP8

Markus

Block-wise FP8 quantization of Qwen/Qwen3-Omni-30B-A3B-Instruct. - Vision encoder (thinker.visual) - Audio tower (thinker.audiotower) - Code2Wav decoder (code2wav) - vLLM >= 0.13.0 with Qwen3-Omni support - 2x 24GB GPUs (e.g., RTX 3090) or equivalent - ~35 GB disk space Block-wise quantization with 128x128 blocks provides better precision than per-tensor quantization while maintaining good compression. Each block has its own scale factor stored as weightscaleinv (inverse scale for efficient multiplication during inference). This is a quantized version of Qwen/Qwen3-Omni-30B-A3B-Instruct. Qwen3-Omni is a natively end-to-end multilingual omni-modal foundation model that processes text…

Open weights other 35.3B parameters transformers

NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows. It extends the Nemotron Nano family with integrated video+speech comprehension, Graphical User Interface (GUI), Optical Character Recognition (OCR), and speech transcription capabilities, enabling end-to-end processing of rich enterprise content such as meeting recordings, M&E assets, training videos, and complex business documents. NVIDIA Nemotron 3 Nano Omni was developed by NVIDIA as part of the Nemotron model family. This model is available for commercial use. This…

Open weights other 18.3B parameters 262,144 tokens transformers

Model · Any to any

gemma-4-12B-it-qat-w4a16-ct

Google

Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in five distinct sizes: E2B, E4B, 12B, 26B A4B, and 31B. Their diverse sizes make them deployable in environments ranging from…

Open weights apache-2.0 13.3B parameters 262,144 tokens transformers