SAVRN
Search Contact SAVRN

Open-weight model · Text ranking

rerank-indonesia-Q8_0-GGUF

by Radhi Fadlillah RadhiFadlillah/rerank-indonesia-Q8_0-GGUF

This model was converted to GGUF format from madebyaris/rerank-indonesia using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

Parameters
Context
Weights132.6 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads

Model Card

By Radhi Fadlillah, published under apache-2.0, revision 368553b0f131.

This model was converted to GGUF format from madebyaris/rerank-indonesia using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model. Install llama.cpp through brew (works on Mac and Linux) Invoke the llama.cpp server or the CLI. Note: You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo as well. Step 2: Move into the llama.cpp folder and build it with LLAMACURL=1 flag along with other hardware-specific flags (for ex: LLAMACUDA=1 for Nvidia GPUs on Linux).

Read Radhi Fadlillah's full model card

This model was converted to GGUF format from madebyaris/rerank-indonesia using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

Use with llama.cpp

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

Invoke the llama.cpp server or the CLI.

CLI:

llama-cli --hf-repo RadhiFadlillah/rerank-indonesia-Q8_0-GGUF --hf-file rerank-indonesia-q8_0.gguf -p "The meaning to life and the universe is"

Server:

llama-server --hf-repo RadhiFadlillah/rerank-indonesia-Q8_0-GGUF --hf-file rerank-indonesia-q8_0.gguf -c 2048

Note: You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo as well.

Step 1: Clone llama.cpp from GitHub.

git clone https://github.com/ggerganov/llama.cpp

Step 2: Move into the llama.cpp folder and build it with LLAMA_CURL=1 flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).

cd llama.cpp && LLAMA_CURL=1 make

Step 3: Run inference through the main binary.

./llama-cli --hf-repo RadhiFadlillah/rerank-indonesia-Q8_0-GGUF --hf-file rerank-indonesia-q8_0.gguf -p "The meaning to life and the universe is"

or

./llama-server --hf-repo RadhiFadlillah/rerank-indonesia-Q8_0-GGUF --hf-file rerank-indonesia-q8_0.gguf -c 2048

Identity and Version

Repository
RadhiFadlillah/rerank-indonesia-Q8_0-GGUF
Publisher
Radhi Fadlillah
Task
Text ranking
Modality
Other
Library
sentence-transformers
Parameters
Not stated by the source
Languages
id
Revision
368553b0f13114d0525b302e2867eadb8c4e08eb
First published
2026-09-18
Last updated
2026-09-18

Files and Weights

3 files, 132.6 MB in total. The weights are 1 file totalling 132.6 MB in gguf.

Weights1 file · 132.6 MB
Documentation1 file · 2.0 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
rerank-indonesia-q8_0.ggufWeights132.6 MB 9125103e48e7
README.mdDocumentation2.0 KB
.gitattributesRepository1.6 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
132.6 MB
Download from Radhi Fadlillah

Released by Radhi Fadlillah through its official repository on Hugging Face. Read the license.

Built From

  • Derived from madebyaris/rerank-indonesia
  • Quantized from madebyaris/rerank-indonesia
  • Trained on (disclosed) google-research-datasets/tydiqa
  • Trained on (disclosed) miracl/miracl

Memory Requirements

PrecisionWeights in memory
As published132.6 MB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About rerank-indonesia-Q8_0-GGUF

Can I use rerank-indonesia-Q8_0-GGUF commercially?

Yes. rerank-indonesia-Q8_0-GGUF is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

This model was trained on the MS Marco Passage Ranking task. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage becomes easier when you have SentenceTransformers installed. Then, you can use the pre-trained models like this: In the following table, we provide various pre-trained Cross-Encoders together with their performance on the TREC Deep Learning 2019 and the MS Marco Passage Reranking dataset.

Open weights apache-2.0 4M parameters 512 tokens sentence-transformers

This model was trained on the MS Marco Passage Ranking task. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage is easy when you have SentenceTransformers installed. Then you can use the pre-trained models like this: In the following table, we provide various pre-trained Cross-Encoders together with their performance on the TREC Deep Learning 2019 and the MS Marco Passage Reranking dataset.

Open weights apache-2.0 16M parameters 512 tokens sentence-transformers

This model was trained on the MS Marco Passage Ranking task. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage is easy when you have SentenceTransformers installed. Then you can use the pre-trained models like this: In the following table, we provide various pre-trained Cross-Encoders together with their performance on the TREC Deep Learning 2019 and the MS Marco Passage Reranking dataset.

Open weights apache-2.0 19M parameters 512 tokens sentence-transformers

This model was trained on the MS Marco Passage Ranking task. The model can be used for Information Retrieval: Given a query, encode the query with all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage is easy when you have SentenceTransformers installed. Then you can use the pre-trained models like this: In the following table, we provide various pre-trained Cross-Encoders together with their performance on the TREC Deep Learning 2019 and the MS Marco Passage Reranking dataset.

Open weights apache-2.0 23M parameters 512 tokens sentence-transformers

This model was trained on the MS Marco Passage Ranking task. The model can be used for Information Retrieval: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. The training code is available here: SBERT.net Training MS Marco The usage is easy when you have SentenceTransformers installed. Then you can use the pre-trained models like this: In the following table, we provide various pre-trained Cross-Encoders together with their performance on the TREC Deep Learning 2019 and the MS Marco Passage Reranking dataset.

Open weights apache-2.0 33M parameters 512 tokens sentence-transformers

Model · Text ranking

mxbai-rerank-xsmall-v1

Mixedbread

This is the smallest model in our family of powerful reranker models. You can learn more about the models in our blog post. Currently, the best way to use our models is with the most recent version of sentence-transformers. pip install -U sentence-transformers Let's say you have a query, and you want to rerank a set of documents. You can do that with only one line of code: Install transformers.js npm i @xenova/transformers Let's say you have a query, and you want to rerank a set of documents. In JavaScript, you need to add a function: You can use the large model via our API as follows: The API comes with additional features, such as a continous trained reranker! Check out the docs for more…

Open weights apache-2.0 71M parameters 512 tokens transformers