SAVRN
Search Contact SAVRN

Open-weight model · Sentence similarity

multi-qa-MiniLM-L6-cos-v1

by Sentence Transformers sentence-transformers/multi-qa-MiniLM-L6-cos-v1

This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and was designed for semantic search. It has been trained on 215M (question, answer) pairs from diverse sources.

Parameters23M
Context512
Weights884.7 MB
License
AccessOpen weights
Monthly Downloads797.5k

Runs On

What it takes to serve multi-qa-MiniLM-L6-cos-v1 (23M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on multi-qa-MiniLM-L6-cos-v1

Questions on one side, answers on the other: that pairing is what Sentence Transformers trained this 23M-parameter embedder on, 215M question-and-answer pairs from sources including ms_marco, gooaq, natural_questions, trivia_qa and eli5. Six layers, a 384-dimensional output, built for semantic search. Memory is 0.1 GB at 16-bit and rounds to 0.0 GB at 8-bit and 4-bit, so the cheapest host we list, one MI300X with 192 GB at $1.85 an hour on-demand, is a card this model shares with whatever generator answers the query.

The license field is blank. Access is open, so the files come from the publisher without a gate, but blank is not permission, and a deployment that earns money needs the terms in writing before it ships. Check the 512-token context against the length of the passages you index. Released March 2, 2022, last updated November 5, 2024, and no Index host prices it per token.

Model Card

This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and was designed for semantic search. It has been trained on 215M (question, answer) pairs from diverse sources. For an introduction to semantic search, have a look at: SBERT.net - Semantic Search Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the correct pooling-operation on-top of the contextualized word embeddings. Similarly to the PyTorch example above, to use the model…

Excerpt from the card by Sentence Transformers.

Configuration

Architecture
BertModel
Context length (tokens)
512
Layers
6
Hidden size
384
Feed-forward size
1,536
Attention heads
12
Vocabulary size
30,522
Model type
bert

Identity and Version

Repository
sentence-transformers/multi-qa-MiniLM-L6-cos-v1
Publisher
Sentence Transformers
Task
Sentence similarity
Modality
Text
Library
sentence-transformers
Parameters
23M parameters
Languages
en
Revision
b207367332321f8e44f96e224ef15bc607f4dbf0
First published
2022-03-02
Last updated
2024-11-05

Files and Weights

29 files, 886.0 MB in total. The weights are 14 files totalling 884.7 MB in bin, h5, onnx, safetensors.

Weights14 files · 884.7 MB
Configuration8 files · 40.7 KB
Tokenizer3 files · 698.1 KB
Documentation1 file · 11.6 KB
Other2 files · 580.0 KB
Repository1 file · 791 B
Every file
FileTypeSizeSHA-256
model.safetensorsWeights90.9 MB 7bec4fd9eba4
onnx/model.onnxWeights90.4 MB 826501e8460f
onnx/model_O1.onnxWeights90.4 MB a4f1223dea8a
onnx/model_O2.onnxWeights90.3 MB 0eca0acdebe2
onnx/model_O3.onnxWeights90.3 MB 3c965811fcb0
onnx/model_O4.onnxWeights45.2 MB e7f3b68bbe14
onnx/model_qint8_arm64.onnxWeights23.0 MB 89779550529b
onnx/model_qint8_avx512.onnxWeights23.0 MB 89779550529b
onnx/model_qint8_avx512_vnni.onnxWeights23.0 MB 89779550529b
onnx/model_quint8_avx2.onnxWeights23.0 MB 773212b274aa
openvino/openvino_model.binWeights90.3 MB 89f9ad00a782
openvino/openvino_model_qint8_quantized.binWeights22.9 MB a7ca78e428d9
pytorch_model.binWeights90.9 MB df507ec1743d
tf_model.h5Weights91.0 MB d356e3a28673
1_Pooling/config.jsonConfiguration190 B
config.jsonConfiguration612 B
config_sentence_transformers.jsonConfiguration116 B
data_config.jsonConfiguration25.5 KB
modules.jsonConfiguration349 B
sentence_bert_config.jsonConfiguration53 B
special_tokens_map.jsonConfiguration112 B
train_script.pyConfiguration13.8 KB
README.mdDocumentation11.6 KB
openvino/openvino_model.xmlOther211.6 KB
openvino/openvino_model_qint8_quantized.xmlOther368.5 KB
.gitattributesRepository791 B
tokenizer.jsonTokenizer466.2 KB
tokenizer_config.jsonTokenizer383 B
vocab.txtTokenizer231.5 KB

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
884.7 MB
Download from Sentence Transformers

Released by Sentence Transformers through its official repository on Hugging Face.

Built From

  • Trained on (disclosed) eli5
  • Trained on (disclosed) embedding-data/Amazon-QA
  • Trained on (disclosed) embedding-data/PAQ_pairs
  • Trained on (disclosed) embedding-data/QQP
  • Trained on (disclosed) embedding-data/WikiAnswers
  • Trained on (disclosed) flax-sentence-embeddings/stackexchange_xml
  • Trained on (disclosed) gooaq
  • Trained on (disclosed) ms_marco
  • Trained on (disclosed) natural_questions
  • Trained on (disclosed) search_qa
  • Trained on (disclosed) trivia_qa
  • Trained on (disclosed) yahoo_answers_topics

Memory Requirements

PrecisionWeights in memory
As published884.7 MB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Compare multi-qa-MiniLM-L6-cos-v1

Questions About multi-qa-MiniLM-L6-cos-v1

How much GPU memory does multi-qa-MiniLM-L6-cos-v1 need?

About 0.1 GB at 16-bit and 0 GB at 4-bit: the weights (23M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run multi-qa-MiniLM-L6-cos-v1 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is multi-qa-MiniLM-L6-cos-v1's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Sentence similarity

all-MiniLM-L6-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. The project aims to train sentence embedding models on very large sentence level datasets using a self-supervised contrastive learning objective. We used the pretrained…

Open weights apache-2.0 23M parameters 512 tokens sentence-transformers

Model · Sentence similarity

paraphrase-MiniLM-L6-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Open weights apache-2.0 23M parameters 512 tokens sentence-transformers

Model · Sentence similarity

paraphrase-MiniLM-L3-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Open weights apache-2.0 17M parameters 512 tokens sentence-transformers

Model · Sentence similarity

bge-micro-v2

Taylor

This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and can be used for tasks like clustering or semantic search. Distilled in a 2-step training process (bge-micro was step 1) from BAAI/bge-small-en-v1.5. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. For an automated evaluation of this model, see the Sentence Embeddings Benchmark: https://seb.sbert.net

Open weights mit 17M parameters 512 tokens sentence-transformers

Model · Sentence similarity

rubert-tiny2

David Dale

This is an updated version of cointegrated/rubert-tiny: a small Russian BERT-based encoder with high-quality sentence embeddings. This post in Russian gives more details. The differences from the previous version include: - sentence embeddings approximate LaBSE closer than before; - meaningful segment embeddings (tuned on the NLI task) - the model is focused only on Russian. The model should be used as is to produce sentence embeddings (e.g. for KNN classification of short texts) or fine-tuned for a downstream task. Sentence embeddings can be produced as follows: Alternatively, you can use the model with sentencetransformers: For those who want to run the inference with VLLM, there is a…

Open weights mit 29M parameters 2,048 tokens sentence-transformers

Model · Sentence similarity

snowflake-arctic-embed-s

Snowflake

12/04/2024: Release of snowflake-arctic-embed-l-v2.0 and snowflake-arctic-embed-m-v2.0 our newest models with multilingual workloads in mind. These models outperform prior versions of Arctic Embed and we suggest these replace prior versions! 07/26/2024: Release preprint [[2407.18887] Embedding And Clustering Your Data Can Improve Contrastive Pretraining](https://arxiv.org/abs/2407.18887) on arXiv. 07/18/2024: Release of snowflake-arctic-embed-m-v1.5, capable of producing highly compressible embedding vectors that preserve quality even when squished as small as 128 bytes per vector. Details about the development of this model are available in the launch post on the Snowflake engineering…

Open weights apache-2.0 33M parameters 512 tokens sentence-transformers