This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).
Open-weight model · Feature extraction
kb-wemm-embedding-2b-mlx-mixed
by Guodong Fei Kn90688/kb-wemm-embedding-2b-mlx-mixed
kb-wemm-embedding-2b-mlx-mixed is an open-weight model for feature extraction from Guodong Fei, released under other. It has 2.2B parameters and a 262,144-token context. At 16-bit it needs about 5.3 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.
Native MLX conversion of ewin-reg/WeMM-Embedding-2B-Quantized — the hybrid FP8-protected attention + group-16 INT4 checkpoint — that preserves its mixed-precision allocation instead of flattening everything to one precision.
Runs On
What it takes to serve kb-wemm-embedding-2b-mlx-mixed (2.2B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 4.4 GB | 5.3 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 2.2 GB | 2.7 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 1.1 GB | 1.3 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.
kb-wemm-embedding-2b-mlx-mixed on every accelerator the SAVRN Index prices, at every precision
Model Card
Native MLX conversion of ewin-reg/WeMM-Embedding-2B-Quantized — the hybrid FP8-protected attention + group-16 INT4 checkpoint — that preserves its mixed-precision allocation instead of flattening everything to one precision. The source checkpoint is curvature-guided: it deliberately keeps the precision-sensitive path at ~8-bit (FP8 E4M3) and compresses only the quantization-robust masses to INT4. Uniform 4-bit quantization destroys that — the source README itself documents softmax attention collapse (DKL >= 7.50) when Q/K go to 4 bits. This build mirrors the Two deviations from the source, both improvements or forced by MLX: - 8-bit group-64 is finer than the source's per-tensor-scalar FP8…
Excerpt from the card by Guodong Fei, licensed other.
Configuration
- Architecture
- Qwen3_5ForConditionalGeneration
- Context length (tokens)
- 262,144
- Layers
- 24
- Hidden size
- 2,048
- Feed-forward size
- 6,144
- Attention heads
- 8
- Key/value heads
- 2
- Head dimension
- 256
- Vocabulary size
- 248,078
- Model type
- qwen3_5
Identity and Version
- Repository
- Kn90688/kb-wemm-embedding-2b-mlx-mixed
- Publisher
- Guodong Fei
- Task
- Feature extraction
- Modality
- Text
- Library
- mlx
- Parameters
- 2.2B parameters
- Languages
- mlx, mrl
- Revision
- 21304656d1e3381d5588a9b9df8748576a59246c
- First published
- 2026-10-09
- Last updated
- 2026-10-09
Files and Weights
14 files, 2.0 GB in total. The weights are 1 file totalling 1.9 GB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors | Weights | 1.9 GB | adbda94232ae |
| config.json | Configuration | 73.5 KB | — |
| config_sentence_transformers.json | Configuration | 245 B | — |
| dequant_report.json | Configuration | 132 B | — |
| model.safetensors.index.json | Configuration | 96.2 KB | — |
| modeling_st_wemm.py | Configuration | 3.2 KB | — |
| modules.json | Configuration | 106 B | — |
| processor_config.json | Configuration | 991 B | — |
| sentence_bert_config.json | Configuration | 950 B | — |
| README.md | Documentation | 5.0 KB | — |
| chat_template.jinja | Other | 7.8 KB | — |
| .gitattributes | Repository | 1.6 KB | — |
| tokenizer.json | Tokenizer | 20.0 MB | 40e444c74451 |
| tokenizer_config.json | Tokenizer | 1.2 KB | — |
License and Download
- License
- other
- Access
- Open weights, no gate
- Download size
- 1.9 GB
Released by Guodong Fei through its official repository on Hugging Face. Read the license.
Built From
- Derived from ewin-reg/WeMM-Embedding-2B-Quantized
- Quantized from ewin-reg/WeMM-Embedding-2B-Quantized
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 1.9 GB |
| 16-bit | 4.4 GB |
| 8-bit | 2.2 GB |
| 4-bit | 1.1 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About kb-wemm-embedding-2b-mlx-mixed
How much GPU memory does kb-wemm-embedding-2b-mlx-mixed need?
About 5.3 GB at 16-bit and 1.3 GB at 4-bit: the weights (2.2B parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run kb-wemm-embedding-2b-mlx-mixed on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
What license is kb-wemm-embedding-2b-mlx-mixed released under?
other, as its publisher declares it. Read the license text before commercial use.
What is kb-wemm-embedding-2b-mlx-mixed's context length?
262,144 tokens, from the maximum position embeddings in its published configuration.
Similar Models
Average score vs. parameter count across image (MIEB-Lite), video (MMEB-V), and audio (MAEB) benchmarks — jina-v5-omni-nano and jina-v5-omni-small define the open-weight frontier (Table 1 in the ArXiv report). jina-embeddings-v5-omni-small is a multimodal embedding model that accepts text, images, video, and audio and produces embeddings in a shared vector space aligned with the text-only jinaai/jina-embeddings-v5-text-small — so you can index with text and query with any modality, no reindexing. For a more compact alternative, see jinaai/jina-embeddings-v5-omni-nano. This is the base repository — it holds all task adapters (retrieval, classification, clustering, text-matching). For a…
A taxonomy-informed sparse DNA foundation model for microbial genomics. MicroGlot is a 23-layer decoder-only mixture-of-experts transformer pretrained on 378.3 billion nucleotides from 3.70 million sequences across 99,700 microbial species, spanning bacteria, archaea, fungi, protists, viruses and plasmids. It encodes the taxonomic hierarchy as hyperbolic (Poincaré) embeddings and uses them both as an input token and to steer expert routing. Paper: A Taxonomy-Informed Sparse DNA Foundation Model for Microbial Genomics\ A species is known if it is one of the 99,700 pretraining species (check with tokenizer.hasspecies(name)). For taxonomic classification tasks, use MicroGlot-plain, as…
Text, images, speech and environmental sounds in one embedding space. Vela Omni Mini supports multimodal search, routing and clustering with normalized vectors that can be compared directly. Scores are 0–100; higher is better. The comparison uses the same held-out evaluation examples, complete retrieval pools and 128-token text cap for both models. Bold marks improvement over the original large model. These known test pools are reused across releases. The common protocol uses labeled TRAIN prototypes for text classification and all matching positives for retrieval; it is separate from official MTEB classification. All 14 metrics, Macro-F1, exact counts and uncertainty. The primary metric…
Dense retriever for patent prior-art search (abstract → abstract), fine-tuned from on patent-family pairs (same invention filed in different jurisdictions / languages). Trained for Korean ↔ English cross-lingual and monolingual patent retrieval. Do not use the base model's asymmetric convention (query: / passage: ). It raises no error but silently degrades retrieval quality, because training was symmetric. corpus (other family members masked; one relevant document per query). crosssame: translation pairs (KR↔EN), crosssimilar: cross-lingual same-family non-translation pairs, monosimilar: monolingual same-family pairs. Scores on the 50k-document subset; full-corpus (209,671 documents)…
Model Type: Feature backbone; Params: 1136M (giant); Image size: 224 x 224 x 3; Patch size: 14 x 14 x 3; Repository: github.com:marrlab/DinoBloom; Original Weights: Zenodo.