SAVRN
Search Contact SAVRN

Open-weight model · Text ranking

gte-reranker-modernbert-base

by Alibaba-NLP Alibaba-NLP/gte-reranker-modernbert-base

We are excited to introduce the gte-modernbert series of models, which are built upon the latest modernBERT pre-trained encoder-only foundation models. The gte-modernbert series models include both text embedding models and rerank models.

Parameters150M
Context8,192
Weights2.5 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads2.6M

Runs On

What it takes to serve gte-reranker-modernbert-base (150M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.3 GB 0.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on gte-reranker-modernbert-base

After the retriever returns its candidates, something must order them, and that is the job of gte-reranker-modernbert-base. It scores a query and a passage as a pair, with an 8,192 token context, so a long passage is judged whole. It needs 0.4 GB at 16-bit, so on the lowest-priced Index configuration, a lone MI300X at $1.85 per hour with 192 GB, it shares a card with the embedding model at no added hardware cost.

Apache 2.0 clears a commercial ranking service: use, modify, redistribute, keep the notices, state significant changes, take the patent grant. Lineage is the check here. The checkpoint is derived from answerdotai/ModernBERT-base, so read that base model's terms, and the paper on file, arXiv:2308.03281, covers the multi-stage contrastive training method. The 15 files total 2.5 GB in safetensors and ONNX against 0.3 GB of 16-bit weights: budget the download, not the memory.

Model Card

By Alibaba-NLP, published under apache-2.0, revision f7481e605550.

We are excited to introduce the gte-modernbert series of models, which are built upon the latest modernBERT pre-trained encoder-only foundation models. The gte-modernbert series models include both text embedding models and rerank models.

The gte-modernbert models demonstrates competitive performance in several text embedding and text retrieval evaluation tasks when compared to similar-scale models from the current open-source community. This includes assessments such as MTEB, LoCO, and COIR evaluation.

Model Overview

  • Developed by: Tongyi Lab, Alibaba Group
  • Model Type: Text reranker
  • Primary Language: English
  • Model Size: 149M
  • Max Input Length: 8192 tokens

Model list

Models Language Model Type Model Size Max Seq. Length Dimension MTEB-en BEIR LoCo CoIR
gte-modernbert-base English text embedding 149M 8192 768 64.38 55.33 87.57 79.31
gte-reranker-modernbert-base English text reranker 149M 8192 - - 56.19 90.68 79.99

Usage

Read the full model card (1,186 words)

Configuration

Architecture
ModernBertForSequenceClassification
Context length (tokens)
8,192
Layers
22
Hidden size
768
Feed-forward size
1,152
Attention heads
12
Vocabulary size
50,368
Stored precision
float32
Model type
modernbert

Identity and Version

Repository
Alibaba-NLP/gte-reranker-modernbert-base
Publisher
Alibaba-NLP
Task
Text ranking
Modality
Other
Library
transformers
Parameters
150M parameters
Languages
en
Revision
f7481e6055501a30fb19d090657df9ec1f79ab2c
First published
2025-01-20
Last updated
2025-07-04

Files and Weights

15 files, 2.5 GB in total. The weights are 9 files totalling 2.5 GB in onnx, safetensors.

Weights9 files · 2.5 GB
Configuration2 files · 2.0 KB
Tokenizer2 files · 3.6 MB
Documentation1 file · 14.2 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights598.4 MB 13c533d902d6
onnx/model.onnxWeights598.8 MB c6d3226502ad
onnx/model_bnb4.onnxWeights217.6 MB 05b830bff59d
onnx/model_fp16.onnxWeights299.6 MB 18acede2913b
onnx/model_int8.onnxWeights150.9 MB ecc6a0ae67ce
onnx/model_q4.onnxWeights224.6 MB abb61e2882c8
onnx/model_q4f16.onnxWeights140.2 MB 72cdd83516ab
onnx/model_quantized.onnxWeights150.9 MB ecc6a0ae67ce
onnx/model_uint8.onnxWeights150.9 MB 7257b9d102dc
config.jsonConfiguration1.3 KB
special_tokens_map.jsonConfiguration694 B
README.mdDocumentation14.2 KB
.gitattributesRepository1.5 KB
tokenizer.jsonTokenizer3.6 MB
tokenizer_config.jsonTokenizer21.0 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
2.5 GB
Download from Alibaba-NLP

Released by Alibaba-NLP through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published2.5 GB
16-bit0.3 GB
8-bit0.1 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Compare gte-reranker-modernbert-base

Questions About gte-reranker-modernbert-base

How much GPU memory does gte-reranker-modernbert-base need?

About 0.4 GB at 16-bit and 0.1 GB at 4-bit: the weights (150M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run gte-reranker-modernbert-base on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use gte-reranker-modernbert-base commercially?

Yes. gte-reranker-modernbert-base is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is gte-reranker-modernbert-base's context length?

8,192 tokens, from the maximum position embeddings in its published configuration.

Similar Models

This is a sentence-transformers model based on a pre-trained DeepPavlov/rubert-base-cased and finetuned with MS-MARCO Russian passage ranking dataset. The model can be used for Information Retrieval in the Russian language: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you need to get the logits from the…

Open weights mit 178M parameters 512 tokens sentence-transformers

This model was trained on the MMARCO dataset. It is a machine translated version of MS MARCO using Google Translate. It was translated to 14 languages. In our experiments, we observed that it performs also well for other languages. As a base model, we used the multilingual MiniLMv2 model. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage becomes easy when you have SentenceTransformers installed. Then, you can use the pre-trained…

Open weights apache-2.0 118M parameters 514 tokens sentence-transformers

This model was trained on the MS Marco Passage Ranking task. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage is easy when you have SentenceTransformers installed. Then you can use the pre-trained models like this: In the following table, we provide various pre-trained Cross-Encoders together with their performance on the TREC Deep Learning 2019 and the MS Marco Passage Reranking dataset.

Open weights apache-2.0 109M parameters 512 tokens sentence-transformers

This model was trained using SentenceTransformers Cross-Encoder class. Given a question and paragraph, can the question be answered by the paragraph? The models have been trained on the GLUE QNLI dataset, which transformed the SQuAD dataset into an NLI task. For performance results of this model, see [SBERT.net Pre-trained Cross-Encoder][https://www.sbert.net/docs/pretrainedcross-encoders.html]. Pre-trained models can be used like this: You can use the model also directly with Transformers library (without SentenceTransformers library)

Open weights apache-2.0 109M parameters 512 tokens sentence-transformers

Model · Text ranking

mxbai-rerank-xsmall-v1

Mixedbread

This is the smallest model in our family of powerful reranker models. You can learn more about the models in our blog post. Currently, the best way to use our models is with the most recent version of sentence-transformers. pip install -U sentence-transformers Let's say you have a query, and you want to rerank a set of documents. You can do that with only one line of code: Install transformers.js npm i @xenova/transformers Let's say you have a query, and you want to rerank a set of documents. In JavaScript, you need to add a function: You can use the large model via our API as follows: The API comes with additional features, such as a continous trained reranker! Check out the docs for more…

Open weights apache-2.0 71M parameters 512 tokens transformers

This model was trained on the MS Marco Passage Ranking task. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage is easy when you have SentenceTransformers installed. Then you can use the pre-trained models like this: In the following table, we provide various pre-trained Cross-Encoders together with their performance on the TREC Deep Learning 2019 and the MS Marco Passage Reranking dataset.

Open weights apache-2.0 33M parameters 512 tokens sentence-transformers