SAVRN
Search Contact SAVRN

Open-weight model · Text ranking

Qwen3-Reranker-4B

by Qwen Qwen/Qwen3-Reranker-4B

The Qwen3 Embedding model series is the latest proprietary model of the Qwen family, specifically designed for text embedding and ranking tasks.

Parameters4B
Context40,960
Weights8.0 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads2.5M

Runs On

What it takes to serve Qwen3-Reranker-4B (4B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 8.0 GB 9.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 4.0 GB 4.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 2.0 GB 2.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on Qwen3-Reranker-4B

Second stage only. A reranker rescores the candidates an embedding search already pulled back, and every query-document pair is a full pass through 36 layers. That makes it compute per query rather than a memory problem: 8.0 GB of weights at 16-bit, 9.7 GB to run, 2.4 GB at 4-bit. On the cheapest setup we list, one 192 GB MI300X at $1.85 an hour, memory never binds; pairs scored per second does, so size for traffic. The 40,960-token context caps query plus document.

Nothing in Apache 2.0 stops you shipping it in a product; keep the notices, state significant changes, plus the patent grant. Check lineage and dates. It is derived from Qwen3-4B-Base, on our hub, and shares one paper with the series' embedding models, arXiv:2506.05176. Released June 3, 2025, files last updated April 16, 2026, ten months on; diff what changed before rebuilding a serving image.

Model Card

By Qwen, published under apache-2.0, revision 22e683669bc0.

## Highlights The Qwen3 Embedding model series is the latest proprietary model of the Qwen family, specifically designed for text embedding and ranking tasks. Building upon the dense foundational models of the Qwen3 series, it provides a comprehensive range of text embeddings and reranking models in various sizes (0.6B, 4B, and 8B). This series inherits the exceptional multilingual capabilities, long-text understanding, and reasoning skills of its foundational model. The Qwen3 Embedding series represents significant advancements in multiple text embedding and ranking tasks, including text retrieval, code retrieval, text classification, text clustering, and bitext mining. **Exceptional Versatility**: The embedding model has achieved state-of-the-art performance across a wide range of downstream application evaluations. The 8B size embedding model ranks No.1 in the MTEB multilingual leaderboard (as of June 5, 2025, score 70.58), while the reranking model excels in various text retrieval scenarios. **Comprehensive Flexibility**: The Qwen3 Embedding series offers a full spectrum of sizes (from 0.6B to 8B) for both embedding and…

Read the full model card (1,609 words)

Configuration

Architecture
Qwen3ForCausalLM
Context length (tokens)
40,960
Layers
36
Hidden size
2,560
Feed-forward size
9,728
Attention heads
32
Key/value heads
8
Head dimension
128
Vocabulary size
151,669
RoPE base
1,000,000
Stored precision
bfloat16
Model type
qwen3

Identity and Version

Repository
Qwen/Qwen3-Reranker-4B
Publisher
Qwen
Task
Text ranking
Modality
Other
Library
transformers
Parameters
4B parameters
Languages
Not stated by the source
Revision
22e683669bc0f0bd69640a1354a6d0aebcfeede5
First published
2025-06-03
Last updated
2026-04-16

Files and Weights

17 files, 8.1 GB in total. The weights are 2 files totalling 8.0 GB in safetensors.

Weights2 files · 8.0 GB
Configuration8 files · 35.4 KB
Tokenizer4 files · 15.9 MB
Documentation1 file · 14.7 KB
Other1 file · 741 B
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00002.safetensorsWeights4.1 GB cf2e87cbf71f
model-00002-of-00002.safetensorsWeights4.0 GB 78946d22b7f6
1_LogitScore/config.jsonConfiguration57 B
config.jsonConfiguration727 B
config_sentence_transformers.jsonConfiguration325 B
generation_config.jsonConfiguration214 B
model.safetensors.index.jsonConfiguration32.8 KB
modules.jsonConfiguration280 B
sentence_bert_config.jsonConfiguration362 B
special_tokens_map.jsonConfiguration613 B
README.mdDocumentation14.7 KB
chat_template.jinjaOther741 B
.gitattributesRepository1.6 KB
merges.txtTokenizer1.7 MB
tokenizer.jsonTokenizer11.4 MB aeb13307a71a
tokenizer_config.jsonTokenizer9.7 KB
vocab.jsonTokenizer2.8 MB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
8.0 GB
Download from Qwen

Released by Qwen through ModelScope. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published8.0 GB
16-bit8.0 GB
8-bit4.0 GB
4-bit2.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Compare Qwen3-Reranker-4B

Questions About Qwen3-Reranker-4B

How much GPU memory does Qwen3-Reranker-4B need?

About 9.7 GB at 16-bit and 2.4 GB at 4-bit: the weights (4B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen3-Reranker-4B on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use Qwen3-Reranker-4B commercially?

Yes. Qwen3-Reranker-4B is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is Qwen3-Reranker-4B's context length?

40,960 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text ranking

Qwen3-VL-Reranker-2B

Qwen

The Qwen3-VL-Embedding and Qwen3-VL-Reranker model series are the latest additions to the Qwen family, built upon the recently open-sourced and powerful Qwen3-VL foundation model. Specifically designed for multimodal information retrieval and cross-modal understanding, this suite accepts diverse inputs including text, images, screenshots, and videos, as well as inputs containing a mixture of these modalities. While the Embedding model generates high-dimensional vectors for broad applications like retrieval and clustering, the Reranker model is engineered to refine these results, establishing a comprehensive pipeline for state-of-the-art multimodal search. Qwen3-VL-Reranker-2B has the…

Open weights apache-2.0 2.1B parameters 262,144 tokens transformers

Model · Text ranking

llama-nemotron-rerank-1b-v2

NVIDIA

The Llama Nemotron Reranking 1B model is optimized for providing a logit score that represents how relevant a document(s) is to a given query. The model was fine-tuned for multilingual, cross-lingual text question-answering retrieval, with support for long documents (up to 8192 tokens). This model was evaluated on 26 languages: English, Arabic, Bengali, Chinese, Czech, Danish, Dutch, Finnish, French, German, Hebrew, Hindi, Hungarian, Indonesian, Italian, Japanese, Korean, Norwegian, Persian, Polish, Portuguese, Russian, Spanish, Swedish, Thai, and Turkish. This model is a component in a text retrieval system to improve the overall accuracy. A text retrieval system often uses an embedding…

Open weights other 1.2B parameters 131,072 tokens transformers

Model · Text ranking

jina-reranker-v3

Jina AI

jina-reranker-v3 is a 0.6B parameter multilingual document reranker with a novel last but not late interaction architecture. Unlike ColBERT's separate encoding with multi-vector matching, this model performs causal self-attention between query and documents within the same context window, extracting contextual embeddings from the last token of each document. Built on Qwen3-0.6B with 28 transformer layers and a lightweight MLP projector (1024→512→256), it processes up to 64 documents simultaneously within 131K token context. The model achieves state-of-the-art BEIR performance with 61.94 nDCG@10 while being 10× smaller than generative listwise rerankers. Use transformers for local inference…

Open weights cc-by-nc-4.0 597M parameters 131,072 tokens transformers

Model · Text ranking

Qwen3-Reranker-0.6B

Qwen

The Qwen3 Embedding model series is the latest proprietary model of the Qwen family, specifically designed for text embedding and ranking tasks. Building upon the dense foundational models of the Qwen3 series, it provides a comprehensive range of text embeddings and reranking models in various sizes (0.6B, 4B, and 8B). This series inherits the exceptional multilingual capabilities, long-text understanding, and reasoning skills of its foundational model. The Qwen3 Embedding series represents significant advancements in multiple text embedding and ranking tasks, including text retrieval, code retrieval, text classification, text clustering, and bitext mining. Exceptional Versatility: The…

Open weights apache-2.0 596M parameters 40,960 tokens transformers

The Jina Reranker v2 (jina-reranker-v2-base-multilingual) is a transformer-based model that has been fine-tuned for text reranking task, which is a crucial component in many information retrieval systems. It is a cross-encoder model that takes a query and a document pair as input and outputs a score indicating the relevance of the document to the query. The model is trained on a large dataset of query-document pairs and is capable of reranking documents in multiple languages with high accuracy. Compared with the state-of-the-art reranker models, including the previous released jina-reranker-v1-base-en, the Jina Reranker v2 model has demonstrated competitiveness across a series of benchmarks…

Open weights cc-by-nc-4.0 278M parameters 1,026 tokens transformers

This is a sentence-transformers model based on a pre-trained DeepPavlov/rubert-base-cased and finetuned with MS-MARCO Russian passage ranking dataset. The model can be used for Information Retrieval in the Russian language: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you need to get the logits from the…

Open weights mit 178M parameters 512 tokens sentence-transformers