Exciting Update!: nomic-embed-text-v1.5 is now multimodal! nomic-embed-vision-v1.5 is aligned to the embedding space of nomic-embed-text-v1.5, meaning any text embedding is multimodal! Important: the text prompt must include a task instruction prefix, instructing the model which task is being performed. For example, if you are implementing a RAG application, you embed your documents as searchdocument: and embed your user queries as searchquery:. Notice: From transformers v5.5.0 and sentence transformers v5.3.0, trustremotecode=True will no longer be necessary. This will only be possible with the text-only series as of now. This prefix is used for embedding texts as documents, for example as…
Open weights
apache-2.0
137M parameters
2,048 tokens
sentence-transformers
nomic-embed-text-v1 is 8192 context length text encoder that surpasses OpenAI text-embedding-ada-002 and text-embedding-3-small performance on short and long context tasks. Exciting Update!: nomic-embed-text-v1 is now multimodal! nomic-embed-vision-v1 is aligned to the embedding space of nomic-embed-text-v1, meaning any text embedding is multimodal! Important: the text prompt must include a task instruction prefix, instructing the model which task is being performed. For example, if you are implementing a RAG application, you embed your documents as searchdocument: and embed your user queries as searchquery:. Notice: From transformers v5.5.0 and sentence transformers v5.3.0…
Open weights
apache-2.0
137M parameters
8,192 tokens
sentence-transformers
This model was presented in the paper Training Sparse Mixture Of Experts Text Embedding Models. nomic-embed-text-v2-moe is a SoTA multilingual MoE text embedding model that excels at multilingual retrieval: Transformer-based text embedding models have improved their performance on benchmarks like MIRACL and BEIR by increasing their parameter counts. However, this scaling approach introduces significant deployment challenges, including increased inference latency and memory usage. These challenges are particularly severe in retrieval-augmented generation (RAG) applications, where large models' increased memory requirements constrain dataset ingestion capacity, and their higher latency…
Open weights
apache-2.0
475M parameters
sentence-transformers