SAVRN
Search Contact SAVRN

Open-weight model · Text ranking

jina-reranker-v3

by Jina AI jinaai/jina-reranker-v3

jina-reranker-v3 is a 0.6B parameter multilingual document reranker with a novel last but not late interaction architecture.

Parameters597M
Context131,072
Weights1.2 GB
Licensecc-by-nc-4.0
AccessOpen weights
Monthly Downloads782.2k

Runs On

What it takes to serve jina-reranker-v3 (597M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 1.2 GB 1.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.6 GB 0.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.3 GB 0.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on jina-reranker-v3

A reranker earns its keep at the second stage of search: the first pass pulls candidates, this one orders them. Jina AI's jina-reranker-v3 does that with 597M parameters and a 131,072-token window, room for up to 64 documents scored in one pass. At 16-bit the weights are 1.2 GB and the model needs 1.4 GB of memory, so fit is never the question. The cheapest setup, one MI300X with 192 GB at $1.85 per hour on-demand, would sit nearly idle serving this alone; we would run it as a tenant beside the retriever it feeds.

The license decides the deployment. CC BY-NC 4.0 allows sharing and adapting with credit for non-commercial use only; a product needs separate permission from the rights holder, so settle that first. It derives from Qwen/Qwen3-0.6B and is described in arXiv:2509.25085. With no host prices in the SAVRN Index, self-hosting is the only path we can price.

Model Card

jina-reranker-v3 is a 0.6B parameter multilingual document reranker with a novel last but not late interaction architecture. Unlike ColBERT's separate encoding with multi-vector matching, this model performs causal self-attention between query and documents within the same context window, extracting contextual embeddings from the last token of each document. Built on Qwen3-0.6B with 28 transformer layers and a lightweight MLP projector (1024→512→256), it processes up to 64 documents simultaneously within 131K token context. The model achieves state-of-the-art BEIR performance with 61.94 nDCG@10 while being 10× smaller than generative listwise rerankers. Use transformers for local inference…

Excerpt from the card by Jina AI, licensed cc-by-nc-4.0.

Configuration

Architecture
JinaForRanking
Context length (tokens)
131,072
Layers
28
Hidden size
1,024
Feed-forward size
3,072
Attention heads
16
Key/value heads
8
Head dimension
128
Vocabulary size
151,936
RoPE base
1,000,000
Stored precision
bfloat16
Model type
qwen3

Identity and Version

Repository
jinaai/jina-reranker-v3
Publisher
Jina AI
Task
Text ranking
Modality
Other
Library
transformers
Parameters
597M parameters
Languages
Not stated by the source
Revision
d7d7e73b6ea138ced340b83865931b5dfb6c97aa
First published
2025-09-18
Last updated
2026-08-10

Files and Weights

12 files, 1.2 GB in total. The weights are 1 file totalling 1.2 GB in safetensors.

Weights1 file · 1.2 GB
Configuration5 files · 13.0 KB
Tokenizer4 files · 15.9 MB
Documentation1 file · 7.0 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.2 GB 200d852626fd
added_tokens.jsonConfiguration795 B
config.jsonConfiguration828 B
generation_config.jsonConfiguration202 B
modeling.pyConfiguration10.4 KB
special_tokens_map.jsonConfiguration777 B
README.mdDocumentation7.0 KB
.gitattributesRepository1.6 KB
merges.txtTokenizer1.7 MB
tokenizer.jsonTokenizer11.4 MB 4e95945ab0ce
tokenizer_config.jsonTokenizer10.7 KB
vocab.jsonTokenizer2.8 MB

License and Download

License
cc-by-nc-4.0
Access
Open weights, no gate
Download size
1.2 GB
Download from Jina AI

Released by Jina AI through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published1.2 GB
16-bit1.2 GB
8-bit0.6 GB
4-bit0.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About jina-reranker-v3

How much GPU memory does jina-reranker-v3 need?

About 1.4 GB at 16-bit and 0.4 GB at 4-bit: the weights (597M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run jina-reranker-v3 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use jina-reranker-v3 commercially?

Not without separate permission. jina-reranker-v3 is released under Creative Commons Attribution-NonCommercial 4.0. CC BY-NC 4.0 permits sharing and adapting with credit for non-commercial purposes only. Commercial use needs separate permission from the rights holder.

What is jina-reranker-v3's context length?

131,072 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text ranking

Qwen3-Reranker-0.6B

Qwen

The Qwen3 Embedding model series is the latest proprietary model of the Qwen family, specifically designed for text embedding and ranking tasks. Building upon the dense foundational models of the Qwen3 series, it provides a comprehensive range of text embeddings and reranking models in various sizes (0.6B, 4B, and 8B). This series inherits the exceptional multilingual capabilities, long-text understanding, and reasoning skills of its foundational model. The Qwen3 Embedding series represents significant advancements in multiple text embedding and ranking tasks, including text retrieval, code retrieval, text classification, text clustering, and bitext mining. Exceptional Versatility: The…

Open weights apache-2.0 596M parameters 40,960 tokens transformers

The Jina Reranker v2 (jina-reranker-v2-base-multilingual) is a transformer-based model that has been fine-tuned for text reranking task, which is a crucial component in many information retrieval systems. It is a cross-encoder model that takes a query and a document pair as input and outputs a score indicating the relevance of the document to the query. The model is trained on a large dataset of query-document pairs and is capable of reranking documents in multiple languages with high accuracy. Compared with the state-of-the-art reranker models, including the previous released jina-reranker-v1-base-en, the Jina Reranker v2 model has demonstrated competitiveness across a series of benchmarks…

Open weights cc-by-nc-4.0 278M parameters 1,026 tokens transformers

This is a sentence-transformers model based on a pre-trained DeepPavlov/rubert-base-cased and finetuned with MS-MARCO Russian passage ranking dataset. The model can be used for Information Retrieval in the Russian language: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you need to get the logits from the…

Open weights mit 178M parameters 512 tokens sentence-transformers

We are excited to introduce the gte-modernbert series of models, which are built upon the latest modernBERT pre-trained encoder-only foundation models. The gte-modernbert series models include both text embedding models and rerank models. The gte-modernbert models demonstrates competitive performance in several text embedding and text retrieval evaluation tasks when compared to similar-scale models from the current open-source community. This includes assessments such as MTEB, LoCO, and COIR evaluation. Use with transformers Use with sentence-transformers: Before you start, install the sentence-transformers libraries: Use with transformers.js Additionally, you can also deploy…

Open weights apache-2.0 150M parameters 8,192 tokens transformers

This model was trained on the MMARCO dataset. It is a machine translated version of MS MARCO using Google Translate. It was translated to 14 languages. In our experiments, we observed that it performs also well for other languages. As a base model, we used the multilingual MiniLMv2 model. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage becomes easy when you have SentenceTransformers installed. Then, you can use the pre-trained…

Open weights apache-2.0 118M parameters 514 tokens sentence-transformers

This model was trained on the MS Marco Passage Ranking task. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage is easy when you have SentenceTransformers installed. Then you can use the pre-trained models like this: In the following table, we provide various pre-trained Cross-Encoders together with their performance on the TREC Deep Learning 2019 and the MS Marco Passage Reranking dataset.

Open weights apache-2.0 109M parameters 512 tokens sentence-transformers