SAVRN
Search Contact SAVRN

Open-weight model · Sentence similarity

bm25

by Qdrant Qdrant/bm25

Repository with files to perform BM25 searches with FastEmbed. BM25 (Best Matching 25) is a ranking function used by search engines to estimate the relevance of documents to a given search query. This model is supposed to be used with Qdrant.

Parameters
Context
Weights84.4 KB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads1.1M

Model Card

By Qdrant, published under apache-2.0, revision 22b8d2af71a7.

Repository with files to perform BM25 searches with FastEmbed. BM25 (Best Matching 25) is a ranking function used by search engines to estimate the relevance of documents to a given search query. This model is supposed to be used with Qdrant. Vectors have to be configured with Modifier.IDF. Here's an example of BM25 with FastEmbed.

Read Qdrant's full model card

Repository with files to perform BM25 searches with FastEmbed.

BM25 (Best Matching 25) is a ranking function used by search engines to estimate the relevance of documents to a given search query.

Usage

Note: This model is supposed to be used with Qdrant. Vectors have to be configured with Modifier.IDF.

Here's an example of BM25 with FastEmbed.

from fastembed import SparseTextEmbedding

documents = [
    "You should stay, study and sprint.",
    "History can only prepare us to be surprised yet again.",
]

model = SparseTextEmbedding(model_name="Qdrant/bm25")
embeddings = list(model.embed(documents))

# [
#     SparseEmbedding(
#         values=array([1.67419738, 1.67419738, 1.67419738, 1.67419738]),
#         indices=array([171321964, 1881538586, 150760872, 1932363795])),
#     SparseEmbedding(values=array(
#         [1.66973021, 1.66973021, 1.66973021, 1.66973021, 1.66973021]),
#                     indices=array([
#                         578407224, 1849833631, 1008800696, 2090661150,
#                         1117393019
#                     ]))
# ]

```

Identity and Version

Repository
Qdrant/bm25
Publisher
Qdrant
Task
Sentence similarity
Modality
Text
Library
transformers
Parameters
Not stated by the source
Languages
en, ar, nl, da, fi, fr, de, el
Revision
22b8d2af71a76161e18dd432d2cee0eefa66e412
First published
2024-06-13
Last updated
2026-08-20

Files and Weights

33 files, 84.4 KB in total.

Configuration1 file · 2 B
Documentation1 file · 1.5 KB
Other30 files · 81.4 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
config.jsonConfiguration2 B
README.mdDocumentation1.5 KB
arabic.txtOther6.3 KB
azerbaijani.txtOther967 B
basque.txtOther2.2 KB
bengali.txtOther5.4 KB
catalan.txtOther1.6 KB
chinese.txtOther5.6 KB
danish.txtOther424 B
dutch.txtOther453 B
english.txtOther936 B
finnish.txtOther1.6 KB
french.txtOther813 B
german.txtOther1.4 KB
greek.txtOther2.2 KB
hebrew.txtOther1.8 KB
hinglish.txtOther6.0 KB
hungarian.txtOther1.2 KB
indonesian.txtOther6.4 KB
italian.txtOther1.7 KB
kazakh.txtOther3.9 KB
nepali.txtOther3.6 KB
norwegian.txtOther851 B
portuguese.txtOther1.3 KB
romanian.txtOther1.9 KB
russian.txtOther1.2 KB
slovene.txtOther16.0 KB
spanish.txtOther2.2 KB
stopwords.txtOther936 B
swedish.txtOther559 B
tajik.txtOther1.8 KB
turkish.txtOther260 B
.gitattributesRepository1.5 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download from Qdrant

Released by Qdrant through its official repository on Hugging Face. Read the license.

Questions About bm25

Can I use bm25 commercially?

Yes. bm25 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Sentence similarity

bge-m3

Beijing Academy of Artificial Intelligence

For more details please refer to our github repo: https://github.com/FlagOpen/FlagEmbedding In this project, we introduce BGE-M3, which is distinguished for its versatility in Multi-Functionality, Multi-Linguality, and Multi-Granularity. Some suggestions for retrieval pipeline in RAG We recommend to use the following pipeline: hybrid retrieval + re-ranking. - Hybrid retrieval leverages the strengths of various methods, offering higher accuracy and stronger generalization capabilities. Now, you can try to use BGE-M3, which supports both embedding and sparse retrieval. This allows you to obtain token weights (similar to the BM25) without any additional cost when generate dense embeddings. To…

Open weights mit 8,194 tokens sentence-transformers

Model · Sentence similarity

bge-small-en-v1.5-onnx-Q

Qdrant

Quantized ONNX port of BAAI/bge-small-en-v1.5 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

Model · Sentence similarity

all-MiniLM-L6-v2-onnx

Qdrant

ONNX port of sentence-transformers/all-MiniLM-L6-v2 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

Model · Sentence similarity

Splade_PP_en_v1

Qdrant

ONNX port of prithivida/SpladePPenv1 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

Model · Sentence similarity

lt-kn-en_familyname-linkage

Abhishek Arora

This is a LinkTransformer model. At its core this model this is a sentence transformer model sentence-transformers model- it just wraps around the class. It is designed for quick and easy record linkage (entity-matching) through the LinkTransformer package. The tasks include clustering, deduplication, linking, aggregation and more. Notwithstanding that, it can be used for any sentence similarity task within the sentence-transformers framework as well. It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Take a look at the documentation of sentence-transformers if you want to use this model for more than what we…

Open weights 512 tokens sentence-transformers

Model · Sentence similarity

paraphrase-albert-small-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Open weights apache-2.0 12M parameters 512 tokens sentence-transformers