all-MiniLM-L6-v2-onnx by Qdrant: Open-Weight Model

Model Card

By Qdrant, published under apache-2.0, revision 5f1b8cd78bc4.

ONNX port of sentence-transformers/all-MiniLM-L6-v2 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Read Qdrant's full model card

ONNX port of sentence-transformers/all-MiniLM-L6-v2 for text classification and similarity searches.

Usage

Here's an example of performing inference using the model with FastEmbed.

from fastembed import TextEmbedding

documents = [
    "You should stay, study and sprint.",
    "History can only prepare us to be surprised yet again.",
]

model = TextEmbedding(model_name="sentence-transformers/all-MiniLM-L6-v2")
embeddings = list(model.embed(documents))

# [
#     array([
#         0.00611658, 0.00068912, -0.0203846, ..., -0.01751488, -0.01174267,
#         0.01463472
#     ],
#           dtype=float32),
#     array([
#         0.00173448, -0.00329958, 0.01557874, ..., -0.01473586, 0.0281806,
#         -0.00448205
#     ],
#           dtype=float32)
# ]

Configuration

Architecture: BertModel
Context length (tokens): 512
Layers: 6
Hidden size: 384
Feed-forward size: 1,536
Attention heads: 12
Vocabulary size: 30,522
Model type: bert

Identity and Version

Repository: Qdrant/all-MiniLM-L6-v2-onnx
Publisher: Qdrant
Task: Sentence similarity
Modality: Text
Library: transformers
Parameters: Not stated by the source
Languages: Not stated by the source
Revision: 5f1b8cd78bc4fb444dd171e59b18f3a3af89a079
First published: 2024-01-16
Last updated: 2025-06-09

Files and Weights

8 files, 91.3 MB in total. The weights are 1 file totalling 90.4 MB in onnx.

Weights1 file · 90.4 MB

Configuration2 files · 1.3 KB

Tokenizer3 files · 944.6 KB

Documentation1 file · 945 B

Repository1 file · 1.5 KB

Every file

File	Type	Size	SHA-256
model.onnx	Weights	90.4 MB	bbd7b466f6d5
config.json	Configuration	650 B	—
special_tokens_map.json	Configuration	695 B	—
README.md	Documentation	945 B	—
.gitattributes	Repository	1.5 KB	—
tokenizer.json	Tokenizer	711.7 KB	—
tokenizer_config.json	Tokenizer	1.4 KB	—
vocab.txt	Tokenizer	231.5 KB	—

License and Download

License: apache-2.0
Access: Open weights, no gate
Download size: 90.4 MB

Download from Qdrant

Released by Qdrant through its official repository on Hugging Face. Read the license.

Memory Requirements

Precision	Weights in memory
As published	90.4 MB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About all-MiniLM-L6-v2-onnx

Can I use all-MiniLM-L6-v2-onnx commercially?

Yes. all-MiniLM-L6-v2-onnx is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is all-MiniLM-L6-v2-onnx's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Sentence similarity

bge-m3

Beijing Academy of Artificial Intelligence

For more details please refer to our github repo: https://github.com/FlagOpen/FlagEmbedding In this project, we introduce BGE-M3, which is distinguished for its versatility in Multi-Functionality, Multi-Linguality, and Multi-Granularity. Some suggestions for retrieval pipeline in RAG We recommend to use the following pipeline: hybrid retrieval + re-ranking. - Hybrid retrieval leverages the strengths of various methods, offering higher accuracy and stronger generalization capabilities. Now, you can try to use BGE-M3, which supports both embedding and sparse retrieval. This allows you to obtain token weights (similar to the BM25) without any additional cost when generate dense embeddings. To…

Open weights mit 8,194 tokens sentence-transformers

View model

Model · Sentence similarity

bge-small-en-v1.5-onnx-Q

Qdrant

Quantized ONNX port of BAAI/bge-small-en-v1.5 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

View model

Model · Sentence similarity

bm25

Qdrant

Repository with files to perform BM25 searches with FastEmbed. BM25 (Best Matching 25) is a ranking function used by search engines to estimate the relevance of documents to a given search query. This model is supposed to be used with Qdrant. Vectors have to be configured with Modifier.IDF. Here's an example of BM25 with FastEmbed.

Open weights apache-2.0 transformers

View model

Model · Sentence similarity

Splade_PP_en_v1

Qdrant

ONNX port of prithivida/SpladePPenv1 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

View model

Model · Sentence similarity

lt-kn-en_familyname-linkage

Abhishek Arora

This is a LinkTransformer model. At its core this model this is a sentence transformer model sentence-transformers model- it just wraps around the class. It is designed for quick and easy record linkage (entity-matching) through the LinkTransformer package. The tasks include clustering, deduplication, linking, aggregation and more. Notwithstanding that, it can be used for any sentence similarity task within the sentence-transformers framework as well. It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Take a look at the documentation of sentence-transformers if you want to use this model for more than what we…

Open weights 512 tokens sentence-transformers

View model

Model · Sentence similarity

paraphrase-albert-small-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Open weights apache-2.0 12M parameters 512 tokens sentence-transformers

View model