# Qwen3-VL-8B-Instruct by Qwen: GPU Requirements and Cost
Source: https://savrn.com/models/qwen3-vl-8b-instruct/gpus
Markdown alternate of the page above; the site index is https://savrn.com/llms.txt

---

## Every Accelerator, Every Precision

How many cards of each accelerator the SAVRN Index prices it takes to hold Qwen3-VL-8B-Instruct, and what that many cards cost an hour at the lowest listed on-demand price. Memory needed: 21 GB at 16-bit, 10.5 GB at 8-bit, 5.3 GB at 4-bit.

| Accelerator | Memory per card | Lowest price per card | 16-bit | 8-bit | 4-bit |
| --- | --- | --- | --- | --- | --- |
| [H100](https://savrn.com/ai-index/pricing/gpus/h100) Voltage Park | 80 GB | $1.99 | 1 card $1.99/hr | 1 card $1.99/hr | 1 card $1.99/hr |
| [H200](https://savrn.com/ai-index/pricing/gpus/h200) GMI Cloud | 141 GB | $2.60 | 1 card $2.60/hr | 1 card $2.60/hr | 1 card $2.60/hr |
| [B200](https://savrn.com/ai-index/pricing/gpus/b200) Vultr | 180 GB | $3.50 | 1 card $3.50/hr | 1 card $3.50/hr | 1 card $3.50/hr |
| [GB200 NVL72](https://savrn.com/ai-index/pricing/gpus/gb200) GMI Cloud | 186 GB | $8.00 | 1 card $8.00/hr | 1 card $8.00/hr | 1 card $8.00/hr |
| [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) Vultr | 192 GB | $1.85 | 1 card $1.85/hr | 1 card $1.85/hr | 1 card $1.85/hr |
| [MI325X](https://savrn.com/ai-index/pricing/gpus/mi325x) Vultr | 256 GB | $2.00 | 1 card $2.00/hr | 1 card $2.00/hr | 1 card $2.00/hr |
| [B300](https://savrn.com/ai-index/pricing/gpus/b300) Massed Compute | 268 GB | $6.60 | 1 card $6.60/hr | 1 card $6.60/hr | 1 card $6.60/hr |
| [GB300 NVL72](https://savrn.com/ai-index/pricing/gpus/gb300) Verda | 279 GB | $11.94 | 1 card $11.94/hr | 1 card $11.94/hr | 1 card $11.94/hr |
| [MI355X](https://savrn.com/ai-index/pricing/gpus/mi355x) Vultr | 288 GB | $2.59 | 1 card $2.59/hr | 1 card $2.59/hr | 1 card $2.59/hr |

## Running It Around the Clock

| Precision | Cheapest setup | Per hour | Per month (730 hours) |
| --- | --- | --- | --- |
| 16-bit | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) (Vultr) | $1.85 | $1,350 |
| 8-bit | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) (Vultr) | $1.85 | $1,350 |
| 4-bit | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) (Vultr) | $1.85 | $1,350 |

One copy of the model on rented cards, busy or idle. Serving more users at once takes more copies or more memory for their contexts.

## Memory at Longer Context

Every token in a sequence keeps a key and a value in every layer. From Qwen3-VL-8B-Instruct's published configuration, that cache adds this much at 16-bit for one sequence:

| Context | Key/value cache | Total with weights | Cheapest setup |
| --- | --- | --- | --- |
| 4,096 tokens | 0.6 GB | 21.6 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| 32,768 tokens | 4.8 GB | 25.8 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| 131,072 tokens | 19.3 GB | 40.3 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| 262,144 tokens (full) | 38.7 GB | 59.7 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |

An estimate from layers, key/value heads and head size, assuming full attention in every layer. Runtimes that quantize or page the cache use less.

## Questions

### How much VRAM does Qwen3-VL-8B-Instruct need?

About 21 GB at 16-bit; about 10.5 GB at 8-bit; about 5.3 GB at 4-bit: the weights plus 20% for the runtime and a short context. A long context needs more.

### What is the cheapest GPU setup to run Qwen3-VL-8B-Instruct?

At 16-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand price the SAVRN Index lists.

### Can Qwen3-VL-8B-Instruct run on a single H100?

Yes at 16-bit, 8-bit, 4-bit: an H100 has 80 GB and Qwen3-VL-8B-Instruct needs 21 GB at 16-bit.

### How much memory does Qwen3-VL-8B-Instruct need at its full context length?

About 59.7 GB at 16-bit for one 262,144-token sequence: 21 GB for the weights and margin plus 38.7 GB of key/value cache, estimated from its published configuration.

Memory is the weights at that precision plus 20% for the runtime and a short context. Prices are the lowest on-demand hourly rates in the [SAVRN Index](https://savrn.com/ai-index/pricing/gpus), read Oct 22, 2026. Setups beyond eight cards, one server, are not listed.

## Qwen3-VL-8B-Instruct

- [Model card, license and download](https://savrn.com/models/qwen3-vl-8b-instruct)
- [All image and text to text models](https://savrn.com/models/tasks/image-and-text-to-text)
- [GPU prices in the SAVRN Index](https://savrn.com/ai-index/pricing/gpus)

## Compared With

- [Qwen2.5-VL-7B-Instruct vs Qwen3-VL-8B-Instruct](https://savrn.com/models/compare/qwen2-5-vl-7b-instruct-vs-qwen3-vl-8b-instruct)
- [Qwen2-VL-7B-Instruct vs Qwen3-VL-8B-Instruct](https://savrn.com/models/compare/qwen2-vl-7b-instruct-vs-qwen3-vl-8b-instruct)
- [Qwen3.5-9B vs Qwen3-VL-8B-Instruct](https://savrn.com/models/compare/qwen3-5-9b-vs-qwen3-vl-8b-instruct)