# Octen-Embedding-8B by Octen-Team: Open-Weight Model Source: https://savrn.com/models/octen-embedding-8b Markdown alternate of the page above; the site index is https://savrn.com/llms.txt --- ## Runs On What it takes to serve Octen-Embedding-8B (7.6B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them. | Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits | | --- | --- | --- | --- | --- | --- | | 16-bit | 15.1 GB | 18.2 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) (192 GB) Vultr | $1.85 | [1x H100](https://savrn.com/ai-index/pricing/gpus/h100) $1.99 · [1x MI325X](https://savrn.com/ai-index/pricing/gpus/mi325x) $2.00 | | 8-bit | 7.6 GB | 9.1 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) (192 GB) Vultr | $1.85 | [1x H100](https://savrn.com/ai-index/pricing/gpus/h100) $1.99 · [1x MI325X](https://savrn.com/ai-index/pricing/gpus/mi325x) $2.00 | | 4-bit | 3.8 GB | 4.5 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) (192 GB) Vultr | $1.85 | [1x H100](https://savrn.com/ai-index/pricing/gpus/h100) $1.99 · [1x MI325X](https://savrn.com/ai-index/pricing/gpus/mi325x) $2.00 | Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the [SAVRN Index](https://savrn.com/ai-index/pricing/gpus), read Oct 24, 2026. [Octen-Embedding-8B on every accelerator the SAVRN Index prices, at every precision](https://savrn.com/models/octen-embedding-8b/gpus) ## SAVRN's Notes on Octen-Embedding-8B Eighteen point two gigabytes: that is what Octen-Embedding-8B needs in 16-bit, against 15.1 GB of weights, and it is the figure that decides where this model lives. The lowest-priced host is one MI300X at $1.85 per hour on-demand, which leaves most of the card for the rest of a retrieval stack. Drop to 8-bit and the need falls to 9.1 GB; 4-bit is 4.5 GB. Octen-Team fine-tuned it from Qwen/Qwen3-Embedding-8B for semantic search and retrieval across multiple languages, and it runs through the sentence-transformers library. Licensing is not the obstacle here: Apache 2.0 permits commercial use, modification and redistribution, with notices kept, significant changes stated and an express patent grant. Check one thing before committing: the configuration lists 40,960 tokens of context while the publisher's summary says up to 32,768, so test at the window you intend to index. Run the base it derives from as the comparison point. SAVRN Research, 2026-09-18 ## Model Card By Octen-Team, published under apache-2.0, revision 5adcfa292e71. Octen-Embedding-8B is a text embedding model developed by [Octen](https://octen.ai/) for semantic search and retrieval tasks. This model is fine-tuned from [Qwen/Qwen3-Embedding-8B](https://savrn.com/models/qwen3-embedding-8b) and supports multiple languages, providing high-quality embeddings for various applications. ### Key Highlights #### RTEB Leaderboard Champion (as of January 12, 2026) - Octen-Embedding-8B ranks #1 on the [RTEB Leaderboard](https://huggingface.co/spaces/mteb/leaderboard) with Mean (Task) score of 0.8045 - Excellent performance on both Public (0.7953) and Private (0.8157) datasets - Demonstrates true generalization capability without overfitting to public benchmarks #### Industry-Oriented Vertical Domain Expertise - Legal: Legal document retrieval - Finance: Financial reports, Q&A, and personal finance content - Healthcare: Medical Q&A, clinical dialogues, and health consultations - Code: Programming problems, code search, and SQL queries #### Ultra-Long Context Support - Supports up to 32,768 tokens context length - Suitable for processing long documents in legal, healthcare, and other domains - High-dimensional embedding space for rich semantic representation #### Multilingual Capability - Supports 100+ languages - Includes various programming languages - Strong multilingual, cross-lingual, and code retrieval capabilities ### Open Source Model List [Read the full model card (725 words)](https://savrn.com/models/octen-embedding-8b/card) ## Configuration Architecture Qwen3Model Context length (tokens) 40,960 Layers 36 Hidden size 4,096 Feed-forward size 12,288 Attention heads 32 Key/value heads 8 Head dimension 128 Vocabulary size 151,665 RoPE base 1,000,000 Model type qwen3 ## Identity and Version Repository Octen/Octen-Embedding-8B Publisher Octen-Team Task Sentence similarity Modality Text Library sentence-transformers Parameters 7.6B parameters Languages en, zh Revision 5adcfa292e712091dfc30f0e97f0b2282e6cc66c First published 2025-12-23 Last updated 2026-02-09 ## Files and Weights 19 files, 15.2 GB in total. The weights are 4 files totalling 15.1 GB in safetensors. Weights4 files · 15.1 GB Configuration8 files · 34.1 KB Tokenizer4 files · 15.9 MB Documentation1 file · 7.8 KB Other1 file · 2.4 KB Repository1 file · 1.6 KB Every file | File | Type | Size | SHA-256 | | --- | --- | --- | --- | | model-00001-of-00004.safetensors | Weights | 4.9 GB | d4dc879c7871 | | model-00002-of-00004.safetensors | Weights | 4.9 GB | c6d695ffcdd5 | | model-00003-of-00004.safetensors | Weights | 5.0 GB | d3c49c8bb16b | | model-00004-of-00004.safetensors | Weights | 335.6 MB | 1b270d0efa5b | | 1_Pooling/config.json | Configuration | 298 B | — | | 2_Normalize/config.json | Configuration | 35 B | — | | added_tokens.json | Configuration | 605 B | — | | config.json | Configuration | 1.5 KB | — | | config_sentence_transformers.json | Configuration | 217 B | — | | model.safetensors.index.json | Configuration | 30.5 KB | — | | modules.json | Configuration | 350 B | — | | special_tokens_map.json | Configuration | 613 B | — | | README.md | Documentation | 7.8 KB | — | | chat_template.jinja | Other | 2.4 KB | — | | .gitattributes | Repository | 1.6 KB | — | | merges.txt | Tokenizer | 1.7 MB | — | | tokenizer.json | Tokenizer | 11.4 MB | 83cdf8c3a34f | | tokenizer_config.json | Tokenizer | 4.7 KB | — | | vocab.json | Tokenizer | 2.8 MB | — | ## License and Download License apache-2.0 Access Open weights, no gate Download size 15.1 GB [Download from Octen-Team](https://huggingface.co/Octen/Octen-Embedding-8B) Released by Octen-Team through its official repository on Hugging Face. [Read the license](https://www.apache.org/licenses/LICENSE-2.0). ## Built From - Derived from [Qwen/Qwen3-Embedding-8B](https://savrn.com/models/qwen3-embedding-8b) ## Memory Requirements | Precision | Weights in memory | | --- | --- | | As published | 15.1 GB | | 16-bit | 15.1 GB | | 8-bit | 7.6 GB | | 4-bit | 3.8 GB | Weights only, from the published parameter count; the key-value cache and runtime add to this. ## Built on This Model - Quantized from[Octen-Embedding-8B-Q8A64-GGUF](https://savrn.com/models/octen-embedding-8b-q8a64-gguf) - Derived from[Octen-Embedding-8B-Q8A64-GGUF](https://savrn.com/models/octen-embedding-8b-q8a64-gguf) ## Questions About Octen-Embedding-8B ### How much GPU memory does Octen-Embedding-8B need? About 18.2 GB at 16-bit and 4.5 GB at 4-bit: the weights (7.6B parameters) plus a working margin. A long context needs more. ### What is the cheapest GPU to run Octen-Embedding-8B on? At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists. ### Can I use Octen-Embedding-8B commercially? Yes. Octen-Embedding-8B is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors. ### What is Octen-Embedding-8B's context length? 40,960 tokens, from the maximum position embeddings in its published configuration. ## Similar Models Model · Sentence similarity ### [MathLeap-Qwen-8B](https://savrn.com/models/mathleap-qwen-8b) [University of Washington Math AI Lab](https://savrn.com/model-publishers/uw-math-ai) A retrieval-tuned embedding model for mathematical text. Fine-tuned from on mathlib4 concepts via multi-view contrastive learning. On MELD — a benchmark of mathematical statements paired across radically different presentations (e.g., set-theoretic vs. category-theoretic phrasings of the same theorem) — MathLeap-Qwen-8B achieves MMR 0.43, beating its base Qwen3-Embedding-8B (0.32, +0.11) and the retrieval-specialized Octen-Embedding-8B (0.42). Each concept has up to four parallel representations: - nlinformal: informal natural-language description (all concepts) - nlinformal2: LLM-generated NL rephrasing (~85% of concepts) - leantype: Lean 4 type signature - leansignature: full Lean 4… Open weights apache-2.0 7.6B parameters 40,960 tokens sentence-transformers [View model](https://savrn.com/models/mathleap-qwen-8b) Model · Sentence similarity ### [AX-Qwen3-Embedding-8B-CUDA-AXQ-NVFP4-W4A4](https://savrn.com/models/ax-qwen3-embedding-8b-cuda-axq-nvfp4-w4a4) [AutomatosX](https://savrn.com/model-publishers/automatosx) AXQuant CUDA NVFP4 W4A4 mixed precision development preview. Converted from the original upstream BF16 source, without AWQ. Native E2M1 FP4 weights and inputs use per-16 E4M3FN scales and FP32 global scales. This is a retrieval embedding checkpoint, with no MTP or generative claim. All attention projections and the first/last two MLP blocks retain original BF16. Remaining MLP matrices use NVFP4 W4A4. Saved query instruction, last-token pooling, exactly one (151643), and L2 normalization. The chat (151645) is not appended. Factory conversion uses AXQuant's NumPy reference RTN encoder, independently checked against preserved BF16 source tensors. Source and pooling assets, calibration and… Open weights apache-2.0 7.6B parameters 40,960 tokens vllm [View model](https://savrn.com/models/ax-qwen3-embedding-8b-cuda-axq-nvfp4-w4a4) Model · Sentence similarity ### [AX-Nemotron-3-Embed-8B-CUDA-AXQ-NVFP4-W4A4](https://savrn.com/models/ax-nemotron-3-embed-8b-cuda-axq-nvfp4-w4a4) [AutomatosX](https://savrn.com/model-publishers/automatosx) AXQuant CUDA NVFP4 W4A4 mixed precision development preview. Converted from the original upstream BF16 source, without AWQ. Native E2M1 FP4 weights and inputs use per-16 E4M3FN scales and FP32 global scales. This is a retrieval embedding checkpoint, with no MTP or generative claim. Eligible attention and MLP matrices use NVFP4 W4A4. Embeddings and norms retain original BF16. Saved query: / passage: prefixes, bidirectional attention, mean pooling and L2 normalization. The native vLLM Ministral alias retains iscausal=false and every actual attention layer is verified as encoder-only. Factory conversion uses AXQuant's NumPy reference RTN encoder, independently checked against preserved BF16… Open weights other 8B parameters 262,144 tokens vllm [View model](https://savrn.com/models/ax-nemotron-3-embed-8b-cuda-axq-nvfp4-w4a4) Model · Sentence similarity ### [Qwen3-VL-Embedding-8B](https://savrn.com/models/qwen3-vl-embedding-8b) [Qwen](https://savrn.com/model-publishers/qwen) The Qwen3-VL-Embedding and Qwen3-VL-Reranker model series are the latest additions to the Qwen family, built upon the recently open-sourced and powerful Qwen3-VL foundation model. Specifically designed for multimodal information retrieval and cross-modal understanding, this suite accepts diverse inputs including text, images, screenshots, and videos, as well as inputs containing a mixture of these modalities. While the Embedding model generates high-dimensional vectors for broad applications like retrieval and clustering, the Reranker model is engineered to refine these results, establishing a comprehensive pipeline for state-of-the-art multimodal search. Qwen3-VL-Embedding-8B has the… Open weights apache-2.0 8.1B parameters 262,144 tokens sentence-transformers [View model](https://savrn.com/models/qwen3-vl-embedding-8b) Model · Sentence similarity ### [AX-Qwen3-Embedding-4B-CUDA-AXQ-NVFP4-W4A4](https://savrn.com/models/ax-qwen3-embedding-4b-cuda-axq-nvfp4-w4a4) [AutomatosX](https://savrn.com/model-publishers/automatosx) AXQuant CUDA NVFP4 W4A4 mixed precision development preview. Converted from the original upstream BF16 source, without AWQ. Native E2M1 FP4 weights and inputs use per-16 E4M3FN scales and FP32 global scales. This is a retrieval embedding checkpoint, with no MTP or generative claim. All attention projections and the first/last two MLP blocks retain original BF16. Remaining MLP matrices use NVFP4 W4A4. Saved query instruction, last-token pooling, exactly one (151643), and L2 normalization. The chat (151645) is not appended. Factory conversion uses AXQuant's NumPy reference RTN encoder, independently checked against preserved BF16 source tensors. Source and pooling assets, calibration and… Open weights apache-2.0 4B parameters 40,960 tokens vllm [View model](https://savrn.com/models/ax-qwen3-embedding-4b-cuda-axq-nvfp4-w4a4) Model · Sentence similarity ### [Qwen3-VL-Embedding-2B](https://savrn.com/models/qwen3-vl-embedding-2b) [Qwen](https://savrn.com/model-publishers/qwen) The Qwen3-VL-Embedding and Qwen3-VL-Reranker model series are the latest additions to the Qwen family, built upon the recently open-sourced and powerful Qwen3-VL foundation model. Specifically designed for multimodal information retrieval and cross-modal understanding, this suite accepts diverse inputs including text, images, screenshots, and videos, as well as inputs containing a mixture of these modalities. While the Embedding model generates high-dimensional vectors for broad applications like retrieval and clustering, the Reranker model is engineered to refine these results, establishing a comprehensive pipeline for state-of-the-art multimodal search. Qwen3-VL-Embedding-2B has the… Open weights apache-2.0 2.1B parameters 262,144 tokens sentence-transformers [View model](https://savrn.com/models/qwen3-vl-embedding-2b) ## Octen-Team [All models and datasets](https://savrn.com/model-publishers/octen) ## Versions - [5adcfa292e71](https://savrn.com/models/octen-embedding-8b/versions/5adcfa292e71) · current 2026-10-05 ## Explore More - [All sentence similarity models](https://savrn.com/models/tasks/sentence-similarity) - [All models under apache-2.0](https://savrn.com/models/licenses/apache-2-0) - [Model comparisons](https://savrn.com/models/comparisons) - [The model directory](https://savrn.com/models) - [Open model prices by host](https://savrn.com/ai-index/pricing/open-models) ## Source - Repository metadata, read 2026-10-19. - [Hugging Face record](https://huggingface.co/Octen/Octen-Embedding-8B) - [How the hub is built](https://savrn.com/model-hub/methodology)