SAVRN
Search Contact SAVRN

Open-weight model · Sentence similarity

e5-base

by Liang Wang intfloat/e5-base

News (May 2023): please switch to e5-base-v2, which has better performance and same method of usage.

Parameters109M
Context512
Weights876.0 MB
Licensemit
AccessOpen weights
Monthly Downloads706k

Runs On

What it takes to serve e5-base (109M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.2 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on e5-base

The question with a 109M-parameter embedding model is not whether it fits but what else shares the card. At 16-bit the weights are 0.2 GB and the working footprint 0.3 GB; at 8-bit and 4-bit both figures round to 0.1 GB. The cheapest setup we price is still one MI300X with 192 GB at $1.85 per hour on-demand, so park it beside a generation model and let it turn sentences into vectors for similarity search. The 512-token context sets the chunk size for anything you index.

MIT is as short as a license gets: commercial use, modification and redistribution are permitted provided the copyright and permission notices ride along. Note the publisher's card points readers to e5-base-v2 as of May 2023, so confirm you want this revision rather than its successor. The listed papers are arXiv:2212.03533 on weakly supervised contrastive pre-training, plus the BEIR and MTEB benchmark papers.

Model Card

By Liang Wang, published under mit, revision b533fe4636f4.

News (May 2023): please switch to e5-base-v2, which has better performance and same method of usage.

Text Embeddings by Weakly-Supervised Contrastive Pre-training. Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei, arXiv 2022

This model has 12 layers and the embedding size is 768.

Usage

Below is an example to encode queries and passages from the MS-MARCO passage ranking dataset.

Read the full model card (699 words)

Configuration

Architecture
BertModel
Context length (tokens)
512
Layers
12
Hidden size
768
Feed-forward size
3,072
Attention heads
12
Vocabulary size
30,522
Stored precision
float32
Model type
bert

Identity and Version

Repository
intfloat/e5-base
Publisher
Liang Wang
Task
Sentence similarity
Modality
Text
Library
sentence-transformers
Parameters
109M parameters
Languages
en
Revision
b533fe4636f4a2507c08ddab40644d20b0006d6a
First published
2022-12-26
Last updated
2023-08-07

Files and Weights

12 files, 876.7 MB in total. The weights are 2 files totalling 876.0 MB in bin, safetensors.

Weights2 files · 876.0 MB
Configuration5 files · 1.4 KB
Tokenizer3 files · 697.9 KB
Documentation1 file · 67.6 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights438.0 MB 1661c4d3b0de
pytorch_model.binWeights438.0 MB bd623a40c8b8
1_Pooling/config.jsonConfiguration200 B
config.jsonConfiguration645 B
modules.jsonConfiguration387 B
sentence_bert_config.jsonConfiguration57 B
special_tokens_map.jsonConfiguration112 B
README.mdDocumentation67.6 KB
.gitattributesRepository1.5 KB
tokenizer.jsonTokenizer466.1 KB
tokenizer_config.jsonTokenizer356 B
vocab.txtTokenizer231.5 KB

License and Download

License
mit
Access
Open weights, no gate
Download size
876.0 MB
Download from Liang Wang

Released by Liang Wang through its official repository on Hugging Face. Read the license.

Built From

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
MTEB AmazonCounterfactualClassification (en) Configuration enTask ClassificationMetric accuracyComparison conditions not established 79.7164 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonCounterfactualClassification (en) Configuration enTask ClassificationMetric apComparison conditions not established 44.1543 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonCounterfactualClassification (en) Configuration enTask ClassificationMetric f1Comparison conditions not established 73.8947 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonPolarityClassification Configuration defaultTask ClassificationMetric accuracyComparison conditions not established 87.9649 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonPolarityClassification Configuration defaultTask ClassificationMetric apComparison conditions not established 84.1017 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonPolarityClassification Configuration defaultTask ClassificationMetric f1Comparison conditions not established 87.9415 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonReviewsClassification (en) Configuration enTask ClassificationMetric accuracyComparison conditions not established 42.646 intfloat
Publisher reported
Evaluated revision not stated
MTEB AmazonReviewsClassification (en) Configuration enTask ClassificationMetric f1Comparison conditions not established 42.2306 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_1Comparison conditions not established 26.814 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_10Comparison conditions not established 42.682 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_100Comparison conditions not established 43.714 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_1000Comparison conditions not established 43.724 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_3Comparison conditions not established 38.11 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric map_at_5Comparison conditions not established 40.667 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_1Comparison conditions not established 27.169 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_10Comparison conditions not established 42.84 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_100Comparison conditions not established 43.864 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_1000Comparison conditions not established 43.875 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_3Comparison conditions not established 38.193 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric mrr_at_5Comparison conditions not established 40.793 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_1Comparison conditions not established 26.814 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_10Comparison conditions not established 51.411 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_100Comparison conditions not established 55.713 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_1000Comparison conditions not established 55.957 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_3Comparison conditions not established 41.955 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric ndcg_at_5Comparison conditions not established 46.558 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_1Comparison conditions not established 26.814 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_10Comparison conditions not established 7.923 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_100Comparison conditions not established 0.978 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_1000Comparison conditions not established 0.1 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_3Comparison conditions not established 17.71 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric precision_at_5Comparison conditions not established 12.859 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_1Comparison conditions not established 26.814 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_10Comparison conditions not established 79.232 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_100Comparison conditions not established 97.795 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_1000Comparison conditions not established 99.644 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_3Comparison conditions not established 53.129 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArguAna Configuration defaultTask RetrievalMetric recall_at_5Comparison conditions not established 64.296 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArxivClusteringP2P Configuration defaultTask ClusteringMetric v_measureComparison conditions not established 44.5693 intfloat
Publisher reported
Evaluated revision not stated
MTEB ArxivClusteringS2S Configuration defaultTask ClusteringMetric v_measureComparison conditions not established 40.4765 intfloat
Publisher reported
Evaluated revision not stated

Memory Requirements

PrecisionWeights in memory
As published876.0 MB
16-bit0.2 GB
8-bit0.1 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Compare e5-base

Questions About e5-base

How much GPU memory does e5-base need?

About 0.3 GB at 16-bit and 0.1 GB at 4-bit: the weights (109M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run e5-base on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use e5-base commercially?

Yes. e5-base is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

What is e5-base's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Sentence similarity

e5-base-v2

Liang Wang

Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei, arXiv 2022 This model has 12 layers and the embedding size is 768. Below is an example to encode queries and passages from the MS-MARCO passage ranking dataset. Please refer to our paper at https://arxiv.org/pdf/2212.03533.pdf. Check out unilm/e5 to reproduce evaluation results on the BEIR and MTEB benchmark. Below is an example for usage with sentencetransformers. Package requirements pip install sentencetransformers~=2.2.2 1. Do I need to add the prefix "query: " and "passage: " to input texts? Yes, this is how the model is trained, otherwise you will see a performance degradation.…

Open weights mit 109M parameters 512 tokens sentence-transformers

This is a sentence-transformers model finetuned from BAAI/bge-base-en-v1.5. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. First install the Sentence Transformers library: Then you can load this model and run inference. Approximate statistics based on the first 45 samples: Approximate statistics based on the first 5 samples: - evalstrategy: steps - perdevicetrainbatchsize: 16 - perdeviceevalbatchsize: 16 - learningrate: 3e-06 - maxsteps: 24 - warmupratio: 0.1 - batchsampler: noduplicates - overwriteoutputdir: False - dopredict: False…

Open weights 109M parameters 512 tokens sentence-transformers

Model · Sentence similarity

pubmedbert-base-embeddings

NeuML

This is a PubMedBERT-base model fined-tuned using sentence-transformers. It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. The training dataset was generated using a random sample of PubMed title-abstract pairs along with similar title pairs. PubMedBERT Embeddings produces higher quality embeddings than generalized models for medical literature. Further fine-tuning for a medical subdomain will result in even better performance. This model can be used to build embeddings databases with txtai for semantic search and/or as a knowledge source for retrieval augmented generation (RAG). Alternatively, the model can…

Open weights apache-2.0 109M parameters 512 tokens sentence-transformers

Model · Sentence similarity

lt-wikidata-comp-en

Dell Research Harvard

This is a LinkTransformer model. At its core this model this is a sentence transformer model sentence-transformers model- it just wraps around the class. It is designed for quick and easy record linkage (entity-matching) through the LinkTransformer package. The tasks include clustering, deduplication, linking, aggregation and more. Notwithstanding that, it can be used for any sentence similarity task within the sentence-transformers framework as well. It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Take a look at the documentation of sentence-transformers if you want to use this model for more than what we…

Open weights 109M parameters 514 tokens sentence-transformers

Model · Sentence similarity

lt-un-data-fine-fine-en

Dell Research Harvard

This is a LinkTransformer model. At its core this model this is a sentence transformer model sentence-transformers model- it just wraps around the class. It is designed for quick and easy record linkage (entity-matching) through the LinkTransformer package. The tasks include clustering, deduplication, linking, aggregation and more. Notwithstanding that, it can be used for any sentence similarity task within the sentence-transformers framework as well. It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Take a look at the documentation of sentence-transformers if you want to use this model for more than what we…

Open weights 109M parameters 514 tokens sentence-transformers

Model · Sentence similarity

names-linking-model

Dell Research Harvard

This is a LinkTransformer model. At its core this model this is a sentence transformer model sentence-transformers model- it just wraps around the class. It is designed for quick and easy record linkage (entity-matching) through the LinkTransformer package. The tasks include clustering, deduplication, linking, aggregation and more. Notwithstanding that, it can be used for any sentence similarity task within the sentence-transformers framework as well. It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Take a look at the documentation of sentence-transformers if you want to use this model for more than what we…

Open weights 109M parameters 514 tokens sentence-transformers