SAVRN
Search Contact SAVRN

Open-weight model · Sentence similarity

bge-m3

by Beijing Academy of Artificial Intelligence BAAI/bge-m3

For more details please refer to our github repo: https://github.com/FlagOpen/FlagEmbedding In this project, we introduce BGE-M3, which is distinguished for its versatility in Multi-Functionality, Multi-Linguality, and Multi-Granularity.

Parameters
Context8,194
Weights2.3 GB
Licensemit
AccessOpen weights
Monthly Downloads38.2M

Model Card

By Beijing Academy of Artificial Intelligence, published under mit, revision 5617a9f61b02.

For more details please refer to our github repo: https://github.com/FlagOpen/FlagEmbedding

BGE-M3 (paper, code)

In this project, we introduce BGE-M3, which is distinguished for its versatility in Multi-Functionality, Multi-Linguality, and Multi-Granularity. - Multi-Functionality: It can simultaneously perform the three common retrieval functionalities of embedding model: dense retrieval, multi-vector retrieval, and sparse retrieval. - Multi-Linguality: It can support more than 100 working languages. - Multi-Granularity: It is able to process inputs of different granularities, spanning from short sentences to long documents of up to 8192 tokens.

Some suggestions for retrieval pipeline in RAG

Read the full model card (1,508 words)

Configuration

Architecture
XLMRobertaModel
Context length (tokens)
8,194
Layers
24
Hidden size
1,024
Feed-forward size
4,096
Attention heads
16
Vocabulary size
250,002
Stored precision
float32
Model type
xlm-roberta

Identity and Version

Repository
BAAI/bge-m3
Publisher
Beijing Academy of Artificial Intelligence
Task
Sentence similarity
Modality
Text
Library
sentence-transformers
Parameters
Not stated by the source
Languages
xlm-roberta
Revision
5617a9f61b028005a4858fdac845db406aefb181
First published
2024-01-27
Last updated
2024-07-03

Files and Weights

30 files, 4.6 GB in total. The weights are 4 files totalling 2.3 GB in bin, onnx, pt.

Weights4 files · 2.3 GB
Configuration8 files · 4.0 KB
Tokenizer4 files · 34.2 MB
Documentation1 file · 15.8 KB
Other11 files · 2.3 GB
Repository2 files · 7.8 KB
Every file
FileTypeSizeSHA-256
colbert_linear.ptWeights2.1 MB 19bfbae397c2
onnx/model.onnxWeights724.9 KB f84251230831
pytorch_model.binWeights2.3 GB b5e0ce3470ab
sparse_linear.ptWeights3.5 KB 45c93804d214
1_Pooling/config.jsonConfiguration191 B
config.jsonConfiguration687 B
config_sentence_transformers.jsonConfiguration123 B
modules.jsonConfiguration349 B
onnx/config.jsonConfiguration698 B
onnx/special_tokens_map.jsonConfiguration964 B
sentence_bert_config.jsonConfiguration54 B
special_tokens_map.jsonConfiguration964 B
README.mdDocumentation15.8 KB
imgs/bm25.jpgOther131.8 KB
imgs/long.jpgOther485.4 KB
imgs/miracl.jpgOther576.5 KB
imgs/mkqa.jpgOther608.0 KB
imgs/nqa.jpgOther158.4 KB
imgs/others.webpOther21.0 KB
long.jpgOther126.9 KB
onnx/Constant_7_attr__valueOther65.6 KB
onnx/model.onnx_dataOther2.3 GB 1eebfb28493f
onnx/sentencepiece.bpe.modelOther5.1 MB cfc8146abe2a
sentencepiece.bpe.modelOther5.1 MB cfc8146abe2a
.gitattributesRepository1.6 KB
imgs/.DS_StoreRepository6.1 KB
onnx/tokenizer.jsonTokenizer17.1 MB 6710678b1267
onnx/tokenizer_config.jsonTokenizer1.2 KB
tokenizer.jsonTokenizer17.1 MB 21106b6d7dab
tokenizer_config.jsonTokenizer444 B

License and Download

License
mit
Access
Open weights, no gate
Download size
2.3 GB
Download from Beijing Academy of Artificial Intelligence

Released by Beijing Academy of Artificial Intelligence through its official repository on Hugging Face. Read the license.

Built From

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
mteb/BRIGHT Task BrightAopsRetrievalMetric BrightAopsRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 4.562 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightAopsRetrieval_default_standardMetric BrightAopsRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 4.562 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightBiologyLongRetrievalMetric BrightBiologyLongRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 14.725 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightBiologyLongRetrieval_default_longMetric BrightBiologyLongRetrieval_default_longSetup Obtained using MTEB v2.10.12Comparison conditions not established 14.725 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightBiologyRetrievalMetric BrightBiologyRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 9.484 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightBiologyRetrieval_default_standardMetric BrightBiologyRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 9.484 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightEarthScienceLongRetrievalMetric BrightEarthScienceLongRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 20.833 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightEarthScienceLongRetrieval_default_longMetric BrightEarthScienceLongRetrieval_default_longSetup Obtained using MTEB v2.10.12Comparison conditions not established 20.833 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightEarthScienceRetrievalMetric BrightEarthScienceRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 15.389 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightEarthScienceRetrieval_default_standardMetric BrightEarthScienceRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 15.389 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightEconomicsLongRetrievalMetric BrightEconomicsLongRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 13.107 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightEconomicsLongRetrieval_default_longMetric BrightEconomicsLongRetrieval_default_longSetup Obtained using MTEB v2.10.12Comparison conditions not established 13.107 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightEconomicsRetrievalMetric BrightEconomicsRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 11.881 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightEconomicsRetrieval_default_standardMetric BrightEconomicsRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 11.881 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightLeetcodeRetrievalMetric BrightLeetcodeRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 24.773 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightLeetcodeRetrieval_default_standardMetric BrightLeetcodeRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 24.773 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightPonyLongRetrievalMetric BrightPonyLongRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 0.464 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightPonyLongRetrieval_default_longMetric BrightPonyLongRetrieval_default_longSetup Obtained using MTEB v2.10.12Comparison conditions not established 0.464 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightPonyRetrievalMetric BrightPonyRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 15.171 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightPonyRetrieval_default_standardMetric BrightPonyRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 15.171 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightPsychologyLongRetrievalMetric BrightPsychologyLongRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 19.307 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightPsychologyLongRetrieval_default_longMetric BrightPsychologyLongRetrieval_default_longSetup Obtained using MTEB v2.10.12Comparison conditions not established 19.307 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightPsychologyRetrievalMetric BrightPsychologyRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 13.263 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightPsychologyRetrieval_default_standardMetric BrightPsychologyRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 13.263 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightRoboticsLongRetrievalMetric BrightRoboticsLongRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 12.376 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightRoboticsLongRetrieval_default_longMetric BrightRoboticsLongRetrieval_default_longSetup Obtained using MTEB v2.10.12Comparison conditions not established 12.376 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightRoboticsRetrievalMetric BrightRoboticsRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 12.149 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightRoboticsRetrieval_default_standardMetric BrightRoboticsRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 12.149 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightStackoverflowLongRetrievalMetric BrightStackoverflowLongRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 8.974 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightStackoverflowLongRetrieval_default_longMetric BrightStackoverflowLongRetrieval_default_longSetup Obtained using MTEB v2.10.12Comparison conditions not established 8.974 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightStackoverflowRetrievalMetric BrightStackoverflowRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 10.628 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightStackoverflowRetrieval_default_standardMetric BrightStackoverflowRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 10.628 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightSustainableLivingLongRetrievalMetric BrightSustainableLivingLongRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 16.852 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightSustainableLivingLongRetrieval_default_longMetric BrightSustainableLivingLongRetrieval_default_longSetup Obtained using MTEB v2.10.12Comparison conditions not established 16.852 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightSustainableLivingRetrievalMetric BrightSustainableLivingRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 10.168 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightSustainableLivingRetrieval_default_standardMetric BrightSustainableLivingRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 10.168 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightTheoremQAQuestionsRetrievalMetric BrightTheoremQAQuestionsRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 12.618 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightTheoremQAQuestionsRetrieval_default_standardMetric BrightTheoremQAQuestionsRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 12.618 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightTheoremQATheoremsRetrievalMetric BrightTheoremQATheoremsRetrievalSetup Obtained using MTEB v2.10.12Comparison conditions not established 4.342 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01
mteb/BRIGHT Task BrightTheoremQATheoremsRetrieval_default_standardMetric BrightTheoremQATheoremsRetrieval_default_standardSetup Obtained using MTEB v2.10.12Comparison conditions not established 4.342 Obtained using MTEB v2.10.12
Reported by a third party
Evaluated revision not stated 2026-04-01

Memory Requirements

PrecisionWeights in memory
As published2.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About bge-m3

Can I use bge-m3 commercially?

Yes. bge-m3 is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

What is bge-m3's context length?

8,194 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Sentence similarity

bge-small-en-v1.5-onnx-Q

Qdrant

Quantized ONNX port of BAAI/bge-small-en-v1.5 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

Model · Sentence similarity

all-MiniLM-L6-v2-onnx

Qdrant

ONNX port of sentence-transformers/all-MiniLM-L6-v2 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

Model · Sentence similarity

bm25

Qdrant

Repository with files to perform BM25 searches with FastEmbed. BM25 (Best Matching 25) is a ranking function used by search engines to estimate the relevance of documents to a given search query. This model is supposed to be used with Qdrant. Vectors have to be configured with Modifier.IDF. Here's an example of BM25 with FastEmbed.

Open weights apache-2.0 transformers

Model · Sentence similarity

Splade_PP_en_v1

Qdrant

ONNX port of prithivida/SpladePPenv1 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

Model · Sentence similarity

lt-kn-en_familyname-linkage

Abhishek Arora

This is a LinkTransformer model. At its core this model this is a sentence transformer model sentence-transformers model- it just wraps around the class. It is designed for quick and easy record linkage (entity-matching) through the LinkTransformer package. The tasks include clustering, deduplication, linking, aggregation and more. Notwithstanding that, it can be used for any sentence similarity task within the sentence-transformers framework as well. It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Take a look at the documentation of sentence-transformers if you want to use this model for more than what we…

Open weights 512 tokens sentence-transformers

Model · Sentence similarity

paraphrase-albert-small-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Open weights apache-2.0 12M parameters 512 tokens sentence-transformers