Model · Sentence similarity
NVIDIA
NVIDIA Nemotron 3 Embed Nemotron-3-Embed-1B-BF16 is a versatile text embedding model trained by NVIDIA and optimized for retrieval and semantic similarity tasks. It provides strong multilingual and cross-lingual retrieval capabilities and is designed to serve as a foundational component in text-based Retrieval-Augmented Generation (RAG) systems. This model was evaluated across 34 languages: English, Arabic, Assamese, Bengali, Bulgarian, Chinese, Danish, Dutch, Finnish, French, German, Hindi, Hinglish, Indonesian, Italian, Japanese, Korean, Malay, Marathi, Nepali, Norwegian, Persian, Portuguese, Romanian, Russian, Spanish, Swahili, Swedish, Tamil, Telugu, Thai, Ukrainian, Urdu, Vietnamese.…
Open weights
other
1.1B parameters
262,144 tokens
sentence-transformers
AXQuant CUDA NVFP4 W4A4 mixed precision development preview. Converted from the original upstream BF16 source, without AWQ. Native E2M1 FP4 weights and inputs use per-16 E4M3FN scales and FP32 global scales. This is a retrieval embedding checkpoint, with no MTP or generative claim. All attention projections and the first/last two MLP blocks retain original BF16. Remaining MLP matrices use NVFP4 W4A4. Saved query instruction, last-token pooling, exactly one (151643), and L2 normalization. The chat (151645) is not appended. Factory conversion uses AXQuant's NumPy reference RTN encoder, independently checked against preserved BF16 source tensors. Source and pooling assets, calibration and…
Open weights
apache-2.0
596M parameters
32,768 tokens
vllm
12/11/2024: Release of Technical Report - 12/04/2024: Release of snowflake-arctic-embed-l-v2.0 and snowflake-arctic-embed-m-v2.0 our newest models with multilingual workloads in mind. Snowflake arctic-embed-l-v2.0 is the newest addition to the suite of embedding models Snowflake has released optimizing for retrieval performance and inference efficiency. Arctic Embed 2.0 introduces a new standard for multilingual embedding models, combining high-quality multilingual text retrieval without sacrificing performance in English. Released under the permissive Apache 2.0 license, Arctic Embed 2.0 is ideal for applications that demand reliable, enterprise-grade multilingual search and retrieval at…
Open weights
apache-2.0
568M parameters
8,194 tokens
sentence-transformers
gte-Qwen2-1.5B-instruct is the latest model in the gte (General Text Embedding) model family. The model is built on Qwen2-1.5B LLM model and use the same training data and strategies as the gte-Qwen2-7B-instruct model. The model incorporates several key advancements: - Integration of bidirectional attention mechanisms, enriching its contextual understanding. - Instruction tuning, applied solely on the query side for streamlined efficiency - Comprehensive training across a vast, multilingual text corpus spanning diverse domains and scenarios. This training leverages both weakly supervised and supervised data, ensuring the model's applicability across numerous languages and a wide array of…
Open weights
apache-2.0
1.8B parameters
131,072 tokens
sentence-transformers
This model was presented in the paper Training Sparse Mixture Of Experts Text Embedding Models. nomic-embed-text-v2-moe is a SoTA multilingual MoE text embedding model that excels at multilingual retrieval: Transformer-based text embedding models have improved their performance on benchmarks like MIRACL and BEIR by increasing their parameter counts. However, this scaling approach introduces significant deployment challenges, including increased inference latency and memory usage. These challenges are particularly severe in retrieval-augmented generation (RAG) applications, where large models' increased memory requirements constrain dataset ingestion capacity, and their higher latency…
Open weights
apache-2.0
475M parameters
sentence-transformers
This is a port of the LaBSE model to PyTorch. It can be used to map 109 languages to a shared vector space. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Have a look at LaBSE for the respective publication that describes LaBSE.
Open weights
apache-2.0
471M parameters
512 tokens
sentence-transformers