Splade_PP_en_v1 by Qdrant: Open-Weight Model

Model Card

By Qdrant, published under apache-2.0, revision efcd182bc7eb.

ONNX port of prithivida/SpladePPenv1 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Read Qdrant's full model card

ONNX port of prithivida/Splade_PP_en_v1 for text classification and similarity searches.

Usage

Here's an example of performing inference using the model with FastEmbed.

from fastembed import SparseTextEmbedding

documents = [
    "You should stay, study and sprint.",
    "History can only prepare us to be surprised yet again.",
]

model = SparseTextEmbedding(model_name="prithivida/Splade_PP_en_v1")
embeddings = list(model.embed(documents))

# [
#     SparseEmbedding(values=array(
#         [0.45940185, 0.64054322, 0.2425732, 0.1623179, 1.20566428,
#          0.62039357...]),
#                     indices=array([1012, 1998, 2000, 2005, 2017, 2022...])),
#     SparseEmbedding(values=array([
#         0.09767706, 0.4374367, 0.00468039, 1.01167965, 1.02318227, 1.30155718
#     ...]),
#                     indices=array([2017, 2022, 2025, 2057, 2064, 2069...]))
# ]

Configuration

Architecture: BertForMaskedLM
Context length (tokens): 512
Layers: 12
Hidden size: 768
Feed-forward size: 3,072
Attention heads: 12
Vocabulary size: 30,522
Model type: bert

Identity and Version

Repository: Qdrant/Splade_PP_en_v1
Publisher: Qdrant
Task: Sentence similarity
Modality: Text
Library: transformers
Parameters: Not stated by the source
Languages: Not stated by the source
Revision: efcd182bc7eb351e81a9445752d4388c2bab500b
First published: 2024-03-13
Last updated: 2024-07-15

Files and Weights

9 files, 533.0 MB in total. The weights are 1 file totalling 532.1 MB in onnx.

Weights1 file · 532.1 MB

Configuration3 files · 1.5 KB

Tokenizer3 files · 944.5 KB

Documentation1 file · 1.0 KB

Repository1 file · 1.5 KB

Every file

File	Type	Size	SHA-256
model.onnx	Weights	532.1 MB	65adbad0d7e1
config.json	Configuration	755 B	—
generation_config.json	Configuration	90 B	—
special_tokens_map.json	Configuration	695 B	—
README.md	Documentation	1.0 KB	—
.gitattributes	Repository	1.5 KB	—
tokenizer.json	Tokenizer	711.6 KB	—
tokenizer_config.json	Tokenizer	1.4 KB	—
vocab.txt	Tokenizer	231.5 KB	—

License and Download

License: apache-2.0
Access: Open weights, no gate
Download size: 532.1 MB

Download from Qdrant

Released by Qdrant through its official repository on Hugging Face. Read the license.

Memory Requirements

Precision	Weights in memory
As published	532.1 MB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Splade_PP_en_v1

Can I use Splade_PP_en_v1 commercially?

Yes. Splade_PP_en_v1 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is Splade_PP_en_v1's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Sentence similarity

bge-m3

Beijing Academy of Artificial Intelligence

For more details please refer to our github repo: https://github.com/FlagOpen/FlagEmbedding In this project, we introduce BGE-M3, which is distinguished for its versatility in Multi-Functionality, Multi-Linguality, and Multi-Granularity. Some suggestions for retrieval pipeline in RAG We recommend to use the following pipeline: hybrid retrieval + re-ranking. - Hybrid retrieval leverages the strengths of various methods, offering higher accuracy and stronger generalization capabilities. Now, you can try to use BGE-M3, which supports both embedding and sparse retrieval. This allows you to obtain token weights (similar to the BM25) without any additional cost when generate dense embeddings. To…

Open weights mit 8,194 tokens sentence-transformers

View model

Model · Sentence similarity

bge-small-en-v1.5-onnx-Q

Qdrant

Quantized ONNX port of BAAI/bge-small-en-v1.5 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

View model

Model · Sentence similarity

all-MiniLM-L6-v2-onnx

Qdrant

ONNX port of sentence-transformers/all-MiniLM-L6-v2 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

View model

Model · Sentence similarity

bm25

Qdrant

Repository with files to perform BM25 searches with FastEmbed. BM25 (Best Matching 25) is a ranking function used by search engines to estimate the relevance of documents to a given search query. This model is supposed to be used with Qdrant. Vectors have to be configured with Modifier.IDF. Here's an example of BM25 with FastEmbed.

Open weights apache-2.0 transformers

View model

Model · Sentence similarity

lt-kn-en_familyname-linkage

Abhishek Arora

This is a LinkTransformer model. At its core this model this is a sentence transformer model sentence-transformers model- it just wraps around the class. It is designed for quick and easy record linkage (entity-matching) through the LinkTransformer package. The tasks include clustering, deduplication, linking, aggregation and more. Notwithstanding that, it can be used for any sentence similarity task within the sentence-transformers framework as well. It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Take a look at the documentation of sentence-transformers if you want to use this model for more than what we…

Open weights 512 tokens sentence-transformers

View model

Model · Sentence similarity

paraphrase-albert-small-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Open weights apache-2.0 12M parameters 512 tokens sentence-transformers

View model