SAVRN
Search Contact SAVRN

Open-weight model · Text ranking

KielEmbed-Rerank

by Tech kiel2/KielEmbed-Rerank

KielEmbed-Rerank is an open-weight model for text ranking from Tech. It has 278M parameters and a 514-token context. At 16-bit it needs about 0.7 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This is a Cross Encoder model finetuned from BAAI/bge-reranker-base using the sentence-transformers library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.

Parameters278M
Context514
Weights1.1 GB
License
AccessOpen weights
Monthly Downloads

Runs On

What it takes to serve KielEmbed-Rerank (278M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.6 GB 0.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.3 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 23, 2026.

KielEmbed-Rerank on every accelerator the SAVRN Index prices, at every precision

Model Card

This is a Cross Encoder model finetuned from BAAI/bge-reranker-base using the sentence-transformers library. It computes scores for pairs of texts, which can be used for text reranking and semantic search. First install the Sentence Transformers library: Then you can load this model and run inference. Approximate statistics based on the first 100 samples: - perdevicetrainbatchsize: 4 - numtrainepochs: 1 - learningrate: 2e-05 - warmupsteps: 0.1 - gradientaccumulationsteps: 8 - fp16: True - perdevicetrainbatchsize: 4 - numtrainepochs: 1 - maxsteps: -1 - learningrate: 2e-05 - lrschedulertype: linear - lrschedulerkwargs: None - warmupsteps: 0.1 - optim: adamwtorchfused - optimargs: None…

Excerpt from the card by Tech.

Configuration

Architecture
XLMRobertaForSequenceClassification
Context length (tokens)
514
Layers
12
Hidden size
768
Feed-forward size
3,072
Attention heads
12
Vocabulary size
250,002
Model type
xlm-roberta

Identity and Version

Repository
kiel2/KielEmbed-Rerank
Publisher
Tech
Task
Text ranking
Modality
Other
Library
sentence-transformers
Parameters
278M parameters
Languages
xlm-roberta
Revision
45c3771e1b393f627b86a023aac4f2505acf72e4
First published
2026-09-23
Last updated
2026-09-23

Files and Weights

9 files, 1.1 GB in total. The weights are 1 file totalling 1.1 GB in safetensors.

Weights1 file · 1.1 GB
Configuration4 files · 1.5 KB
Tokenizer2 files · 17.1 MB
Documentation1 file · 14.7 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.1 GB d9d2e9476473
config.jsonConfiguration841 B
config_sentence_transformers.jsonConfiguration262 B
modules.jsonConfiguration131 B
sentence_bert_config.jsonConfiguration225 B
README.mdDocumentation14.7 KB
.gitattributesRepository1.6 KB
tokenizer.jsonTokenizer17.1 MB 31584ba60435
tokenizer_config.jsonTokenizer408 B

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
1.1 GB
Download from Tech

Released by Tech through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published1.1 GB
16-bit0.6 GB
8-bit0.3 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About KielEmbed-Rerank

How much GPU memory does KielEmbed-Rerank need?

About 0.7 GB at 16-bit and 0.2 GB at 4-bit: the weights (278M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run KielEmbed-Rerank on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is KielEmbed-Rerank's context length?

514 tokens, from the maximum position embeddings in its published configuration.

Similar Models

The Jina Reranker v2 (jina-reranker-v2-base-multilingual) is a transformer-based model that has been fine-tuned for text reranking task, which is a crucial component in many information retrieval systems. It is a cross-encoder model that takes a query and a document pair as input and outputs a score indicating the relevance of the document to the query. The model is trained on a large dataset of query-document pairs and is capable of reranking documents in multiple languages with high accuracy. Compared with the state-of-the-art reranker models, including the previous released jina-reranker-v1-base-en, the Jina Reranker v2 model has demonstrated competitiveness across a series of benchmarks…

Open weights cc-by-nc-4.0 278M parameters 1,026 tokens transformers

This is a sentence-transformers model based on a pre-trained DeepPavlov/rubert-base-cased and finetuned with MS-MARCO Russian passage ranking dataset. The model can be used for Information Retrieval in the Russian language: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you need to get the logits from the…

Open weights mit 178M parameters 512 tokens sentence-transformers

We are excited to introduce the gte-modernbert series of models, which are built upon the latest modernBERT pre-trained encoder-only foundation models. The gte-modernbert series models include both text embedding models and rerank models. The gte-modernbert models demonstrates competitive performance in several text embedding and text retrieval evaluation tasks when compared to similar-scale models from the current open-source community. This includes assessments such as MTEB, LoCO, and COIR evaluation. Use with transformers Use with sentence-transformers: Before you start, install the sentence-transformers libraries: Use with transformers.js Additionally, you can also deploy…

Open weights apache-2.0 150M parameters 8,192 tokens transformers

This model was trained on the MMARCO dataset. It is a machine translated version of MS MARCO using Google Translate. It was translated to 14 languages. In our experiments, we observed that it performs also well for other languages. As a base model, we used the multilingual MiniLMv2 model. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage becomes easy when you have SentenceTransformers installed. Then, you can use the pre-trained…

Open weights apache-2.0 118M parameters 514 tokens sentence-transformers

This model was trained on the MS Marco Passage Ranking task. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage is easy when you have SentenceTransformers installed. Then you can use the pre-trained models like this: In the following table, we provide various pre-trained Cross-Encoders together with their performance on the TREC Deep Learning 2019 and the MS Marco Passage Reranking dataset.

Open weights apache-2.0 109M parameters 512 tokens sentence-transformers

This model was trained using SentenceTransformers Cross-Encoder class. Given a question and paragraph, can the question be answered by the paragraph? The models have been trained on the GLUE QNLI dataset, which transformed the SQuAD dataset into an NLI task. For performance results of this model, see [SBERT.net Pre-trained Cross-Encoder][https://www.sbert.net/docs/pretrainedcross-encoders.html]. Pre-trained models can be used like this: You can use the model also directly with Transformers library (without SentenceTransformers library)

Open weights apache-2.0 109M parameters 512 tokens sentence-transformers