gte-Qwen2-1.5B-instruct is the latest model in the gte (General Text Embedding) model family. The model is built on Qwen2-1.5B LLM model and use the same training data and strategies as the gte-Qwen2-7B-instruct model. The model incorporates several key advancements: - Integration of bidirectional attention mechanisms, enriching its contextual understanding. - Instruction tuning, applied solely on the query side for streamlined efficiency - Comprehensive training across a vast, multilingual text corpus spanning diverse domains and scenarios. This training leverages both weakly supervised and supervised data, ensuring the model's applicability across numerous languages and a wide array of…
Open weights
apache-2.0
1.8B parameters
131,072 tokens
sentence-transformers
Model · Sentence similarity
NVIDIA
NVIDIA Nemotron 3 Embed Nemotron-3-Embed-1B-BF16 is a versatile text embedding model trained by NVIDIA and optimized for retrieval and semantic similarity tasks. It provides strong multilingual and cross-lingual retrieval capabilities and is designed to serve as a foundational component in text-based Retrieval-Augmented Generation (RAG) systems. This model was evaluated across 34 languages: English, Arabic, Assamese, Bengali, Bulgarian, Chinese, Danish, Dutch, Finnish, French, German, Hindi, Hinglish, Indonesian, Italian, Japanese, Korean, Malay, Marathi, Nepali, Norwegian, Persian, Portuguese, Romanian, Russian, Spanish, Swahili, Swedish, Tamil, Telugu, Thai, Ukrainian, Urdu, Vietnamese.…
Open weights
other
1.1B parameters
262,144 tokens
sentence-transformers
12/11/2024: Release of Technical Report - 12/04/2024: Release of snowflake-arctic-embed-l-v2.0 and snowflake-arctic-embed-m-v2.0 our newest models with multilingual workloads in mind. Snowflake arctic-embed-l-v2.0 is the newest addition to the suite of embedding models Snowflake has released optimizing for retrieval performance and inference efficiency. Arctic Embed 2.0 introduces a new standard for multilingual embedding models, combining high-quality multilingual text retrieval without sacrificing performance in English. Released under the permissive Apache 2.0 license, Arctic Embed 2.0 is ideal for applications that demand reliable, enterprise-grade multilingual search and retrieval at…
Open weights
apache-2.0
568M parameters
8,194 tokens
sentence-transformers
This model was presented in the paper Training Sparse Mixture Of Experts Text Embedding Models. nomic-embed-text-v2-moe is a SoTA multilingual MoE text embedding model that excels at multilingual retrieval: Transformer-based text embedding models have improved their performance on benchmarks like MIRACL and BEIR by increasing their parameter counts. However, this scaling approach introduces significant deployment challenges, including increased inference latency and memory usage. These challenges are particularly severe in retrieval-augmented generation (RAG) applications, where large models' increased memory requirements constrain dataset ingestion capacity, and their higher latency…
Open weights
apache-2.0
475M parameters
sentence-transformers
This is a port of the LaBSE model to PyTorch. It can be used to map 109 languages to a shared vector space. Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Have a look at LaBSE for the respective publication that describes LaBSE.
Open weights
apache-2.0
471M parameters
512 tokens
sentence-transformers
Model · Sentence similarity
Zulfah
Semantic-Lite-2 is a lightweight multilingual sentence embedding model that produces 256-dimensional semantic vectors. It is designed for semantic search, sentence similarity, clustering, retrieval, and retrieval-augmented generation (RAG) tasks. The model is built on top of the Spark-X2.5-1.7B backbone using a frozen-backbone plus trainable-projection-head approach. The 256-dimensional output keeps vector storage compact while preserving strong retrieval quality. Vectors are L2-normalized, so cosine similarity is computed as a simple dot product. Evaluated on 500 Indonesian NLI evaluation pairs (retrieval task, chance level 0.2%): Cross-lingual evaluation (10 languages, 20 pairs per…
Open weights
apache-2.0
460M parameters
1,048,576 tokens
transformers
