For more details please refer to our Github: FlagEmbedding. If you are looking for a model that supports more languages, longer texts, and other retrieval methods, you can try using bge-m3. FlagEmbedding focuses on retrieval-augmented LLMs, consisting of the following projects currently: - 1/30/2024: Release BGE-M3, a new member to BGE model series! M3 stands for Multi-linguality (100+ languages), Multi-granularities (input length up to 8192), Multi-Functionality (unification of dense, lexical, multi-vec/colbert retrieval). It is the first embedding model that supports all three retrieval methods, achieving new SOTA on multi-lingual (MIRACL) and cross-lingual (MKQA) benchmarks. Technical…
Open weights
mit
335M parameters
512 tokens
sentence-transformers
Here, we provide several ways to produce sentence embeddings. Please note that you have to provide the prompt Represent this sentence for searching relevant passages: for query if you want to use it for retrieval. Besides that you don't need any prompt. Our model also supports Matryoshka Representation Learning and binary quantization. Here, we provide several ways to produce sentence embeddings. Please note that you have to provide the prompt Represent this sentence for searching relevant passages: for query if you want to use it for retrieval. Besides that you don't need any prompt. If you haven't already, you can install the Transformers.js JavaScript library from NPM using: You can then…
Open weights
apache-2.0
335M parameters
512 tokens
sentence-transformers
WhereIsAI/UAE-Large-V1 is licensed under MIT. Feel free to use it in any scenario. If you use it for academic papers, you could cite us via citation info. Welcome to using AnglE to train and infer powerful sentence embeddings. Achievements - May 16, 2024 | AnglE's paper is accepted by ACL 2024 Main Conference - Dec 4, 2023 | Our universal English sentence embedding WhereIsAI/UAE-Large-V1 achieves SOTA on the MTEB Leaderboard with an average score of 64.64! - WhereIsAI/UAE-Code-Large-V1: This model can be used for code or GitHub issue similarity measurement. There is no need to specify any prompts. For retrieval purposes, please use the prompt Prompts.C for query (not for document). Infinity…
Open weights
mit
335M parameters
512 tokens
sentence-transformers
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei, arXiv 2024 This model has 24 layers and the embedding size is 1024. Below are examples to encode queries and passages from the MS-MARCO passage ranking dataset. Usage with Infinity: This model is initialized from xlm-roberta-large and continually trained on a mixture of multilingual datasets. It supports 100 languages from xlm-roberta, but low-resource languages may see performance degradation. First stage: contrastive pre-training with 1 billion weakly supervised text pairs. Check out unilm/e5 to reproduce evaluation results on the BEIR and MTEB benchmark. 1. Do I need to add instructions to the query? Yes, this…
Open weights
mit
560M parameters
514 tokens
sentence-transformers
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei, arXiv 2024 This model has 24 layers and the embedding size is 1024. Below is an example to encode queries and passages from the MS-MARCO passage ranking dataset. This model is initialized from xlm-roberta-large and continually trained on a mixture of multilingual datasets. It supports 100 languages from xlm-roberta, but low-resource languages may see performance degradation. For all labeled datasets, we only use its training set for fine-tuning. For other training details, please refer to our paper at https://arxiv.org/pdf/2402.05672. Check out unilm/e5 to reproduce evaluation results on the BEIR and MTEB…
Open weights
mit
560M parameters
514 tokens
sentence-transformers
We have updated the new reranker, supporting larger lengths, more languages, and achieving better performance. More details please refer to our Github: FlagEmbedding. FlagEmbedding focuses on retrieval-augmented LLMs, consisting of the following projects currently: - 3/18/2024: Release new rerankers, built upon powerful M3 and LLM (GEMMA and MiniCPM, not so large actually) backbones, supporitng multi-lingual processing and larger inputs, massive improvements of ranking performances on BEIR, C-MTEB/Retrieval, MIRACL, LlamaIndex Evaluation. - 3/18/2024: Release Visualized-BGE, equipping BGE with visual capabilities. Visualized-BGE can be utilized to generate embeddings for hybrid image-text…
Open weights
mit
560M parameters
514 tokens
transformers
