SAVRN
Search Contact SAVRN

Open-weight model · Sentence similarity

lt-kn-en_familyname-linkage

by Abhishek Arora 96abhishekarora/lt-kn-en_familyname-linkage

This is a LinkTransformer model. At its core this model this is a sentence transformer model sentence-transformers model- it just wraps around the class. It is designed for quick and easy record linkage (entity-matching) through the LinkTransformer package.

Parameters
Context512
Weights711.5 MB
License
AccessOpen weights
Monthly Downloads85

Model Card

This is a LinkTransformer model. At its core this model this is a sentence transformer model sentence-transformers model- it just wraps around the class. It is designed for quick and easy record linkage (entity-matching) through the LinkTransformer package. The tasks include clustering, deduplication, linking, aggregation and more. Notwithstanding that, it can be used for any sentence similarity task within the sentence-transformers framework as well. It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Take a look at the documentation of sentence-transformers if you want to use this model for more than what we…

Excerpt from the card by Abhishek Arora.

Configuration

Architecture
BertModel
Context length (tokens)
512
Layers
12
Hidden size
768
Feed-forward size
3,072
Attention heads
12
Vocabulary size
119,547
Stored precision
float32
Model type
bert

Identity and Version

Repository
96abhishekarora/lt-kn-en_familyname-linkage
Publisher
Abhishek Arora
Task
Sentence similarity
Modality
Text
Library
sentence-transformers
Parameters
Not stated by the source
Languages
kn, en
Revision
2065bfc00cc161123d32d82782e492f8a8e33ddb
First published
2023-09-01
Last updated
2023-09-04

Files and Weights

13 files, 715.4 MB in total. The weights are 1 file totalling 711.5 MB in bin.

Weights1 file · 711.5 MB
Configuration7 files · 2.6 KB
Tokenizer3 files · 3.9 MB
Documentation1 file · 5.4 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
pytorch_model.binWeights711.5 MB b729ce841823
1_Pooling/config.jsonConfiguration190 B
LT_training_config.jsonConfiguration1.0 KB
config.jsonConfiguration830 B
config_sentence_transformers.jsonConfiguration123 B
modules.jsonConfiguration229 B
sentence_bert_config.jsonConfiguration53 B
special_tokens_map.jsonConfiguration125 B
README.mdDocumentation5.4 KB
.gitattributesRepository1.7 KB
tokenizer.jsonTokenizer2.9 MB
tokenizer_config.jsonTokenizer343 B
vocab.txtTokenizer995.5 KB

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
711.5 MB
Download from Abhishek Arora

Released by Abhishek Arora through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published711.5 MB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About lt-kn-en_familyname-linkage

What is lt-kn-en_familyname-linkage's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Sentence similarity

bge-m3

Beijing Academy of Artificial Intelligence

For more details please refer to our github repo: https://github.com/FlagOpen/FlagEmbedding In this project, we introduce BGE-M3, which is distinguished for its versatility in Multi-Functionality, Multi-Linguality, and Multi-Granularity. Some suggestions for retrieval pipeline in RAG We recommend to use the following pipeline: hybrid retrieval + re-ranking. - Hybrid retrieval leverages the strengths of various methods, offering higher accuracy and stronger generalization capabilities. Now, you can try to use BGE-M3, which supports both embedding and sparse retrieval. This allows you to obtain token weights (similar to the BM25) without any additional cost when generate dense embeddings. To…

Open weights mit 8,194 tokens sentence-transformers

Model · Sentence similarity

bge-small-en-v1.5-onnx-Q

Qdrant

Quantized ONNX port of BAAI/bge-small-en-v1.5 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

Model · Sentence similarity

all-MiniLM-L6-v2-onnx

Qdrant

ONNX port of sentence-transformers/all-MiniLM-L6-v2 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

Model · Sentence similarity

bm25

Qdrant

Repository with files to perform BM25 searches with FastEmbed. BM25 (Best Matching 25) is a ranking function used by search engines to estimate the relevance of documents to a given search query. This model is supposed to be used with Qdrant. Vectors have to be configured with Modifier.IDF. Here's an example of BM25 with FastEmbed.

Open weights apache-2.0 transformers

Model · Sentence similarity

Splade_PP_en_v1

Qdrant

ONNX port of prithivida/SpladePPenv1 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.

Open weights apache-2.0 512 tokens transformers

Model · Sentence similarity

paraphrase-albert-small-v2

Sentence Transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Open weights apache-2.0 12M parameters 512 tokens sentence-transformers