SAVRN
Search Contact SAVRN

Open-weight model · Sentence similarity

e5-small-v2

by Liang Wang intfloat/e5-small-v2

Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei, arXiv 2022 This model has 12 layers and the embedding size is 384.

Parameters33M
Context512
Weights801.2 MB
Licensemit
AccessOpen weights
Monthly Downloads545.7k

Runs On

What it takes to serve e5-small-v2 (33M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on e5-small-v2

Thirty-three million parameters and a 384-wide embedding: that is the whole footprint, which is why we treat e5-small-v2 as a retrieval component rather than a model you plan a rack around. It turns queries and passages into vectors for similarity search, 512 tokens per input. At 16-bit the weights are 0.1 GB and the memory needed is 0.1 GB. The cheapest Index entry, one MI300X at $1.85 per hour, has 192 GB for a job that needs a tenth of one, so it rides beside whatever model already occupies the card.

MIT is about as light as licensing gets: commercial use, modification and redistribution, with the notices kept. Two things to check. The publisher's usage prefixes inputs with query: and passage:, and an index built without those prefixes is not the same index. And the stored precision is float32, so the 16-bit figure assumes conversion on load.

Model Card

By Liang Wang, published under mit, revision ffb93f3bd404.

Text Embeddings by Weakly-Supervised Contrastive Pre-training. Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei, arXiv 2022

This model has 12 layers and the embedding size is 384.

Usage

Below is an example to encode queries and passages from the MS-MARCO passage ranking dataset.

Read the full model card (682 words)

Configuration

Architecture
BertModel
Context length (tokens)
512
Layers
12
Hidden size
384
Feed-forward size
1,536
Attention heads
12
Vocabulary size
30,522
Stored precision
float32
Model type
bert

Identity and Version

Repository
intfloat/e5-small-v2
Publisher
Liang Wang
Task
Sentence similarity
Modality
Text
Library
sentence-transformers
Parameters
33M parameters
Languages
en
Revision
ffb93f3bd4047442299a41ebb6fa998a38507c52
First published
2023-05-19
Last updated
2025-02-17

Files and Weights

20 files, 803.2 MB in total. The weights are 8 files totalling 801.2 MB in bin, h5, onnx, safetensors.

Weights8 files · 801.2 MB
Configuration5 files · 1.4 KB
Tokenizer3 files · 943.2 KB
Documentation1 file · 67.8 KB
Other2 files · 1.0 MB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.onnxWeights133.1 MB 4b8205be2a3c
model.safetensorsWeights133.5 MB 45bfa6007064
onnx/model_O4.onnxWeights66.6 MB 5a0ed8686280
onnx/model_qint8_avx512_vnni.onnxWeights34.1 MB ac5f66639a99
openvino/openvino_model.binWeights132.9 MB 96e21f1ba645
openvino/openvino_model_qint8_quantized.binWeights33.8 MB 840ce3ea5543
pytorch_model.binWeights133.5 MB 4790fed2919e
tf_model.h5Weights133.7 MB 2944a3d38da7
1_Pooling/config.jsonConfiguration200 B
config.jsonConfiguration615 B
modules.jsonConfiguration387 B
sentence_bert_config.jsonConfiguration57 B
special_tokens_map.jsonConfiguration125 B
README.mdDocumentation67.8 KB
openvino/openvino_model.xmlOther362.5 KB
openvino/openvino_model_qint8_quantized.xmlOther663.5 KB
.gitattributesRepository1.5 KB
tokenizer.jsonTokenizer711.4 KB
tokenizer_config.jsonTokenizer314 B
vocab.txtTokenizer231.5 KB

License and Download

License
mit
Access
Open weights, no gate
Download size
801.2 MB
Download from Liang Wang

Released by Liang Wang through its official repository on Hugging Face. Read the license.

Built From

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
MTEB AmazonCounterfactualClassification (en) Configuration enTask ClassificationMetric accuracyComparison conditions not established 77.597 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonCounterfactualClassification (en) Configuration enTask ClassificationMetric apComparison conditions not established 41.6706 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonCounterfactualClassification (en) Configuration enTask ClassificationMetric f1Comparison conditions not established 71.8647 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonPolarityClassification Configuration defaultTask ClassificationMetric accuracyComparison conditions not established 91.2659 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonPolarityClassification Configuration defaultTask ClassificationMetric apComparison conditions not established 87.6763 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonPolarityClassification Configuration defaultTask ClassificationMetric f1Comparison conditions not established 91.243 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonReviewsClassification (en) Configuration enTask ClassificationMetric accuracyComparison conditions not established 45.882 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonReviewsClassification (en) Configuration enTask ClassificationMetric f1Comparison conditions not established 45.0806 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_1Comparison conditions not established 20.697 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_10Comparison conditions not established 33.975 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_100Comparison conditions not established 35.223 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_1000Comparison conditions not established 35.26 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_3Comparison conditions not established 29.777 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_5Comparison conditions not established 32.035 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_1Comparison conditions not established 20.982 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_10Comparison conditions not established 34.094 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_100Comparison conditions not established 35.343 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_1000Comparison conditions not established 35.38 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_3Comparison conditions not established 29.884 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_5Comparison conditions not established 32.142 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_1Comparison conditions not established 20.697 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_10Comparison conditions not established 41.668 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_100Comparison conditions not established 47.397 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_1000Comparison conditions not established 48.305 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_3Comparison conditions not established 32.928 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_5Comparison conditions not established 36.999 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_1Comparison conditions not established 20.697 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_10Comparison conditions not established 6.636 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_100Comparison conditions not established 0.924 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_1000Comparison conditions not established 0.099 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_3Comparison conditions not established 14.035 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_5Comparison conditions not established 10.398 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_1Comparison conditions not established 20.697 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_10Comparison conditions not established 66.358 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_100Comparison conditions not established 92.39 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_1000Comparison conditions not established 99.36 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_3Comparison conditions not established 42.105 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_5Comparison conditions not established 51.991 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArxivClusteringP2P Configuration defaultTask ClusteringMetric v_measureComparison conditions not established 42.117 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArxivClusteringS2S Configuration defaultTask ClusteringMetric v_measureComparison conditions not established 34.7955 intfloat
Publisher reported
Evaluated revision not stated

Memory Requirements

PrecisionWeights in memory
As published801.2 MB
16-bit0.1 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Compare e5-small-v2

Questions About e5-small-v2

How much GPU memory does e5-small-v2 need?

About 0.1 GB at 16-bit and 0 GB at 4-bit: the weights (33M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run e5-small-v2 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use e5-small-v2 commercially?

Yes. e5-small-v2 is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

What is e5-small-v2's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Sentence similarity

all-MiniLM-L12-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. The project aims to train sentence embedding models on very large sentence level datasets using a self-supervised contrastive learning objective. We used the pretrained…

Open weights apache-2.0 33M parameters 512 tokens sentence-transformers

Model · Sentence similarity

gte-small

Dingkun Long

General Text Embeddings (GTE) model. Towards General Text Embeddings with Multi-stage Contrastive Learning The GTE models are trained by Alibaba DAMO Academy. They are mainly based on the BERT framework and currently offer three different sizes of models, including GTE-large, GTE-base, and GTE-small. The GTE models are trained on a large-scale corpus of relevance text pairs, covering a wide range of domains and scenarios. This enables the GTE models to be applied to various downstream tasks of text embeddings, including information retrieval, semantic textual similarity, text reranking, etc. We compared the performance of the GTE models with other popular text embedding models on the MTEB…

Open weights mit 33M parameters 512 tokens sentence-transformers

Model · Sentence similarity

snowflake-arctic-embed-s

Snowflake

12/04/2024: Release of snowflake-arctic-embed-l-v2.0 and snowflake-arctic-embed-m-v2.0 our newest models with multilingual workloads in mind. These models outperform prior versions of Arctic Embed and we suggest these replace prior versions! 07/26/2024: Release preprint [[2407.18887] Embedding And Clustering Your Data Can Improve Contrastive Pretraining](https://arxiv.org/abs/2407.18887) on arXiv. 07/18/2024: Release of snowflake-arctic-embed-m-v1.5, capable of producing highly compressible embedding vectors that preserve quality even when squished as small as 128 bytes per vector. Details about the development of this model are available in the launch post on the Snowflake engineering…

Open weights apache-2.0 33M parameters 512 tokens sentence-transformers

Model · Sentence similarity

rubert-tiny2

David Dale

This is an updated version of cointegrated/rubert-tiny: a small Russian BERT-based encoder with high-quality sentence embeddings. This post in Russian gives more details. The differences from the previous version include: - sentence embeddings approximate LaBSE closer than before; - meaningful segment embeddings (tuned on the NLI task) - the model is focused only on Russian. The model should be used as is to produce sentence embeddings (e.g. for KNN classification of short texts) or fine-tuned for a downstream task. Sentence embeddings can be produced as follows: Alternatively, you can use the model with sentencetransformers: For those who want to run the inference with VLLM, there is a…

Open weights mit 29M parameters 2,048 tokens sentence-transformers

Model · Sentence similarity

all-MiniLM-L6-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. The project aims to train sentence embedding models on very large sentence level datasets using a self-supervised contrastive learning objective. We used the pretrained…

Open weights apache-2.0 23M parameters 512 tokens sentence-transformers

Model · Sentence similarity

paraphrase-MiniLM-L6-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 384 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Open weights apache-2.0 23M parameters 512 tokens sentence-transformers