Skip to page content
SAVRN
Search Plan a project

Open-weight model · Sentence similarity

lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024

by Dangerousmanleebyeonggeon dangerousmanleebyeonggeon/lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024

lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024 is an open-weight model for sentence similarity from Dangerousmanleebyeonggeon. It has 149M parameters and a 8,192-token context. At 16-bit it needs about 0.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This is a PyLate model finetuned from lightonai/LateOn. It maps sentences & paragraphs to sequences of 128-dimensional dense vectors and can be used for semantic textual similarity using the MaxSim operator.

Parameters149M
Context8,192
Weights615.3 MB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024 (149M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.3 GB 0.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 19, 2026.

lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024 on every accelerator the SAVRN Index prices, at every precision

Model Card

This is a PyLate model finetuned from lightonai/LateOn. It maps sentences & paragraphs to sequences of 128-dimensional dense vectors and can be used for semantic textual similarity using the MaxSim operator. Use this model with PyLate to index and retrieve documents. The index uses FastPLAID for efficient similarity search. Load the ColBERT model and initialize the PLAID index, then encode and index your documents: Note that you do not have to recreate the index and encode the documents every time. Once you have created an index and added the documents, you can re-use the index later by loading it: Once the documents are indexed, you can retrieve the top-k most relevant documents for a…

Excerpt from the card by Dangerousmanleebyeonggeon.

Configuration

Architecture
ModernBertModel
Context length (tokens)
8,192
Layers
22
Hidden size
768
Feed-forward size
1,152
Attention heads
12
Vocabulary size
50,370
Model type
modernbert

Identity and Version

Repository
dangerousmanleebyeonggeon/lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024
Publisher
Dangerousmanleebyeonggeon
Task
Sentence similarity
Modality
Text
Library
PyLate
Parameters
149M parameters
Languages
Not stated by the source
Revision
255ce2a7f0082d1a345ac49afb6c16707c625410
First published
2026-10-11
Last updated
2026-10-11

Files and Weights

15 files, 619.0 MB in total. The weights are 4 files totalling 615.3 MB in safetensors.

Weights4 files · 615.3 MB
Configuration7 files · 3.7 KB
Tokenizer2 files · 3.6 MB
Documentation1 file · 50.7 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
1_Dense/model.safetensorsWeights9.4 MB f9f61ca81dc3
2_Dense/model.safetensorsWeights9.4 MB 4f44e3b51e9f
3_Dense/model.safetensorsWeights393.3 KB 059b4508d36b
model.safetensorsWeights596.1 MB 2e7f1ecb9030
1_Dense/config.jsonConfiguration160 B —
2_Dense/config.jsonConfiguration160 B —
3_Dense/config.jsonConfiguration160 B —
config.jsonConfiguration1.9 KB —
config_sentence_transformers.jsonConfiguration763 B —
modules.jsonConfiguration422 B —
sentence_bert_config.jsonConfiguration58 B —
README.mdDocumentation50.7 KB —
.gitattributesRepository1.5 KB —
tokenizer.jsonTokenizer3.6 MB —
tokenizer_config.jsonTokenizer542 B —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
615.3 MB
Download from Dangerousmanleebyeonggeon

Released by Dangerousmanleebyeonggeon through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published615.3 MB
16-bit0.3 GB
8-bit0.1 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024

How much GPU memory does lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024 need?

About 0.4 GB at 16-bit and 0.1 GB at 4-bit: the weights (149M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is lateon-msmarco-hardneg-n10573-e1-ckpt82-qd1024's context length?

8,192 tokens, from the maximum position embeddings in its published configuration.

Similar Models

This is a PyLate model finetuned from lightonai/LateOn. It maps sentences & paragraphs to sequences of 128-dimensional dense vectors and can be used for semantic textual similarity using the MaxSim operator. Use this model with PyLate to index and retrieve documents. The index uses FastPLAID for efficient similarity search. Load the ColBERT model and initialize the PLAID index, then encode and index your documents: Note that you do not have to recreate the index and encode the documents every time. Once you have created an index and added the documents, you can re-use the index later by loading it: Once the documents are indexed, you can retrieve the top-k most relevant documents for a…

Open weights 149M parameters 8,192 tokens PyLate

Model · Sentence similarity

KielEmbed-Vision

Tech

This is a sentence-transformers model finetuned from sentence-transformers/clip-ViT-B-32. It maps sentences & paragraphs to a 512-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, classification, clustering, and more. First install the Sentence Transformers library: Then you can load this model and run inference. Approximate statistics based on the first 100 samples: - numtrainepochs: 1 - learningrate: 2e-05 - warmupsteps: 0.1 - gradientaccumulationsteps: 4 - fp16: True - perdevicetrainbatchsize: 8 - numtrainepochs: 1 - maxsteps: -1 - learningrate: 2e-05 - lrschedulertype: linear - lrschedulerkwargs: None - warmupsteps: 0.1…

Open weights 151M parameters 77 tokens sentence-transformers

Model · Sentence similarity

nomic-embed-text-v1.5

Nomic AI

Exciting Update!: nomic-embed-text-v1.5 is now multimodal! nomic-embed-vision-v1.5 is aligned to the embedding space of nomic-embed-text-v1.5, meaning any text embedding is multimodal! Important: the text prompt must include a task instruction prefix, instructing the model which task is being performed. For example, if you are implementing a RAG application, you embed your documents as searchdocument: and embed your user queries as searchquery:. Notice: From transformers v5.5.0 and sentence transformers v5.3.0, trustremotecode=True will no longer be necessary. This will only be possible with the text-only series as of now. This prefix is used for embedding texts as documents, for example as…

Open weights apache-2.0 137M parameters 2,048 tokens sentence-transformers

Model · Sentence similarity

nomic-embed-text-v1

Nomic AI

nomic-embed-text-v1 is 8192 context length text encoder that surpasses OpenAI text-embedding-ada-002 and text-embedding-3-small performance on short and long context tasks. Exciting Update!: nomic-embed-text-v1 is now multimodal! nomic-embed-vision-v1 is aligned to the embedding space of nomic-embed-text-v1, meaning any text embedding is multimodal! Important: the text prompt must include a task instruction prefix, instructing the model which task is being performed. For example, if you are implementing a RAG application, you embed your documents as searchdocument: and embed your user queries as searchquery:. Notice: From transformers v5.5.0 and sentence transformers v5.3.0…

Open weights apache-2.0 137M parameters 8,192 tokens sentence-transformers

This is a sentence-transformers model: It maps sentences & paragraphs to a 512 dimensional dense vector space and can be used for tasks like clustering or semantic search. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Open weights apache-2.0 135M parameters 512 tokens sentence-transformers