SAVRN
Search Contact SAVRN

Open-weight model · Text generation

Qwen2.5-VL-7B-Instruct-NVFP4

by NVIDIA nvidia/Qwen2.5-VL-7B-Instruct-NVFP4

Qwen2.5-VL-7B-Instruct-NVFP4 is an open-weight model for text generation from NVIDIA, released under other. It has 5B parameters and a 128,000-token context. At 16-bit it needs about 12.1 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 1.3M downloads a month.

The NVIDIA Qwen2.5-VL-7B-Instruct-FP4 model is the quantized version of Alibaba's Qwen2.5-VL-7B-Instruct model, which is an auto-regressive language model that uses an optimized transformer architecture. For more information, please check here.

Parameters5B
Context128,000
Weights7.2 GB
Licenseother
AccessOpen weights
Monthly Downloads1.3M

Runs On

What it takes to serve Qwen2.5-VL-7B-Instruct-NVFP4 (5B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 10.1 GB 12.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 5.0 GB 6.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 2.5 GB 3.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 7, 2026.

Qwen2.5-VL-7B-Instruct-NVFP4 on every accelerator the SAVRN Index prices, at every precision

Model Card

The NVIDIA Qwen2.5-VL-7B-Instruct-FP4 model is the quantized version of Alibaba's Qwen2.5-VL-7B-Instruct model, which is an auto-regressive language model that uses an optimized transformer architecture. For more information, please check here. The NVIDIA Qwen2.5-VL-7B-Instruct-FP4 model is quantized with TensorRT Model Optimizer. This model is ready for commercial/non-commercial use. This model is not owned or developed by NVIDIA. It was developed and built to a third party’s requirements for this application and use case. See the Non-NVIDIA (Qwen2.5-VL-7B-Instruct) Model Card. Use of this model is governed by nvidia-open-model-license Global, except in European Union Developers looking to…

Excerpt from the card by NVIDIA, licensed other.

Configuration

Architecture
Qwen2_5_VLForConditionalGeneration
Context length (tokens)
128,000
Layers
28
Hidden size
3,584
Feed-forward size
18,944
Attention heads
28
Key/value heads
4
Vocabulary size
152,064
Sliding window (tokens)
32,768
RoPE base
1e+06
Stored precision
bfloat16
Model type
qwen2_5_vl
Quantization
modelopt

Identity and Version

Repository
nvidia/Qwen2.5-VL-7B-Instruct-NVFP4
Publisher
NVIDIA
Task
Text generation
Modality
Text
Library
Model Optimizer
Parameters
5B parameters
Languages
Not stated by the source
Revision
d13bb1f2d8fbbd9f16cbb7688c8d6b6932d797d7
First published
2025-09-10
Last updated
2025-12-06

Files and Weights

18 files, 7.2 GB in total. The weights are 2 files totalling 7.2 GB in safetensors.

Weights2 files · 7.2 GB
Configuration8 files · 116.9 KB
Tokenizer4 files · 15.9 MB
Documentation2 files · 92.9 KB
Other1 file · 1.0 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00002.safetensorsWeights5.0 GB e1fd4af01e69
model-00002-of-00002.safetensorsWeights2.2 GB b67d3920398d
added_tokens.jsonConfiguration605 B —
config.jsonConfiguration4.6 KB —
generation_config.jsonConfiguration214 B —
hf_quant_config.jsonConfiguration318 B —
model.safetensors.index.jsonConfiguration109.0 KB —
preprocessor_config.jsonConfiguration791 B —
special_tokens_map.jsonConfiguration388 B —
video_preprocessor_config.jsonConfiguration935 B —
LICENSE.pdfDocumentation76.7 KB —
README.mdDocumentation16.2 KB —
chat_template.jinjaOther1.0 KB —
.gitattributesRepository1.7 KB —
merges.txtTokenizer1.7 MB —
tokenizer.jsonTokenizer11.4 MB 9c5ae00e602b
tokenizer_config.jsonTokenizer4.7 KB —
vocab.jsonTokenizer2.8 MB —

License and Download

License
other
Access
Open weights, no gate
Download size
7.2 GB
Download from NVIDIA

Released by NVIDIA through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published7.2 GB
16-bit10.1 GB
8-bit5.0 GB
4-bit2.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Qwen2.5-VL-7B-Instruct-NVFP4

How much GPU memory does Qwen2.5-VL-7B-Instruct-NVFP4 need?

About 12.1 GB at 16-bit and 3 GB at 4-bit: the weights (5B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen2.5-VL-7B-Instruct-NVFP4 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Qwen2.5-VL-7B-Instruct-NVFP4 released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen2.5-VL-7B-Instruct-NVFP4's context length?

128,000 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

FrogNano-4B-2609-MLX-4bit

CapyCTL

A 4-bit MLX affine quantization of microsoft/FrogNano-4B-2609 (revision b90468c1), made so TensorFold can serve it on NVIDIA GPUs. TensorFold's CUDA engine reads quantized weights only; the original checkpoint is BF16. All credit for the model goes to its authors. Read the original model card for intended use, limitations and safety guidance; they apply unchanged. This repository changes only the storage format. The conversion script is in the CapyCTL recipe linked below. --no-drafts is required: there is no drafter for this model, and TensorFold's Qwen dense engine on CUDA needs either a drafter or --no-drafts. --parallel 8 decodes up to eight requests together; without it TensorFold on…

Open weights mit 4.8B parameters 262,144 tokens mlx

Qwen3-Coder is available in multiple sizes. Today, we're excited to introduce Qwen3-Coder-30B-A3B-Instruct. This streamlined model maintains impressive performance and efficiency, featuring the following key enhancements: - Significant Performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks. - Long-context Capabilities with native support for 256K tokens, extendable up to 1M tokens using Yarn, optimized for repository-scale understanding. - Agentic Coding supporting for most platform such as Qwen Code, CLINE, featuring a specially designed function call format. Qwen3-Coder-30B-A3B-Instruct has the following features: NOTE: This model…

Open weights apache-2.0 5.3B parameters 262,144 tokens transformers

Model · Text generation

Fleet-Semantic-4B

Noumenon, Inc.

Fleet is a dynamically extensible Semantic Inference Language Model (SiLM) built on Qwen/Qwen3-4B-Instruct-2507. Fleet is not an external prompt router. The routing system lives inside the causal language model itself through the custom FleetForCausalLM architecture. Fleet replaces selected Qwen projections with native FleetLinear modules. The model also contains a dynamic semantic prototype bank: Routing therefore happens inside model inference, rather than through an external classifier that chooses a different model before generation. This checkpoint currently contains six specialists: - mathreasoning - medicalreasoning - legalops - intent - functioncalling - structured The base Qwen…

Open weights other 4.4B parameters 262,144 tokens transformers

Model · Text generation

Qwen3-4B-Instruct-2507-FP8

Qwen

We introduce the updated version of the Qwen3-4B-FP8 non-thinking mode, named Qwen3-4B-Instruct-2507-FP8, featuring the following key enhancements: - Significant improvements in general capabilities, including instruction following, logical reasoning, text comprehension, mathematics, science, coding and tool usage. - Substantial gains in long-tail knowledge coverage across multiple languages. - Markedly better alignment with user preferences in subjective and open-ended tasks, enabling more helpful responses and higher-quality text generation. - Enhanced capabilities in 256K long-context understanding. This repo contains the FP8 version of Qwen3-4B-Instruct-2507, which has the following…

Open weights apache-2.0 4.4B parameters 262,144 tokens transformers

An OpenRLHF GRPO reinforcement-learning checkpoint for Qwen3-4B. - Saved at global step 16 of RL run seededrlbaseramp25stoppengen4kep2ncp10q4v3groot16. - This is the best checkpoint by pass@8 so far in this run (evaldefaultpass8 = 0.1244). Trained and validated on the cobalt-train ≤2/64 frontier (canonical cleaneval prompts): 1833 train / 112 held-out val problems the base model solved on at most 2 of 64 samples under the iidcanonical@64 hardness scan. Val evals sample at temperature 1.0 (matching the cleaneval frontier eval). Reward signal: binary code-correctness (1.0 if the generated program passes the problem's tests, otherwise 0.0). Eval metrics at this checkpoint (held-out val, 8…

Open weights 4.4B parameters 262,144 tokens transformers