Skip to page content
SAVRN
Search Plan a project

Open-weight model · Feature extraction

kb-wemm-embedding-2b-mlx-mixed

by Guodong Fei Kn90688/kb-wemm-embedding-2b-mlx-mixed

kb-wemm-embedding-2b-mlx-mixed is an open-weight model for feature extraction from Guodong Fei, released under other. It has 2.2B parameters and a 262,144-token context. At 16-bit it needs about 5.3 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

Native MLX conversion of ewin-reg/WeMM-Embedding-2B-Quantized — the hybrid FP8-protected attention + group-16 INT4 checkpoint — that preserves its mixed-precision allocation instead of flattening everything to one precision.

Parameters2.2B
Context262,144
Weights1.9 GB
Licenseother
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve kb-wemm-embedding-2b-mlx-mixed (2.2B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 4.4 GB 5.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 2.2 GB 2.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 1.1 GB 1.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

kb-wemm-embedding-2b-mlx-mixed on every accelerator the SAVRN Index prices, at every precision

Model Card

Native MLX conversion of ewin-reg/WeMM-Embedding-2B-Quantized — the hybrid FP8-protected attention + group-16 INT4 checkpoint — that preserves its mixed-precision allocation instead of flattening everything to one precision. The source checkpoint is curvature-guided: it deliberately keeps the precision-sensitive path at ~8-bit (FP8 E4M3) and compresses only the quantization-robust masses to INT4. Uniform 4-bit quantization destroys that — the source README itself documents softmax attention collapse (DKL >= 7.50) when Q/K go to 4 bits. This build mirrors the Two deviations from the source, both improvements or forced by MLX: - 8-bit group-64 is finer than the source's per-tensor-scalar FP8…

Excerpt from the card by Guodong Fei, licensed other.

Configuration

Architecture
Qwen3_5ForConditionalGeneration
Context length (tokens)
262,144
Layers
24
Hidden size
2,048
Feed-forward size
6,144
Attention heads
8
Key/value heads
2
Head dimension
256
Vocabulary size
248,078
Model type
qwen3_5

Identity and Version

Repository
Kn90688/kb-wemm-embedding-2b-mlx-mixed
Publisher
Guodong Fei
Task
Feature extraction
Modality
Text
Library
mlx
Parameters
2.2B parameters
Languages
mlx, mrl
Revision
21304656d1e3381d5588a9b9df8748576a59246c
First published
2026-10-09
Last updated
2026-10-09

Files and Weights

14 files, 2.0 GB in total. The weights are 1 file totalling 1.9 GB in safetensors.

Weights1 file · 1.9 GB
Configuration8 files · 175.2 KB
Tokenizer2 files · 20.0 MB
Documentation1 file · 5.0 KB
Other1 file · 7.8 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.9 GB adbda94232ae
config.jsonConfiguration73.5 KB —
config_sentence_transformers.jsonConfiguration245 B —
dequant_report.jsonConfiguration132 B —
model.safetensors.index.jsonConfiguration96.2 KB —
modeling_st_wemm.pyConfiguration3.2 KB —
modules.jsonConfiguration106 B —
processor_config.jsonConfiguration991 B —
sentence_bert_config.jsonConfiguration950 B —
README.mdDocumentation5.0 KB —
chat_template.jinjaOther7.8 KB —
.gitattributesRepository1.6 KB —
tokenizer.jsonTokenizer20.0 MB 40e444c74451
tokenizer_config.jsonTokenizer1.2 KB —

License and Download

License
other
Access
Open weights, no gate
Download size
1.9 GB
Download from Guodong Fei

Released by Guodong Fei through its official repository on Hugging Face. Read the license.

Built From

  • Derived from ewin-reg/WeMM-Embedding-2B-Quantized
  • Quantized from ewin-reg/WeMM-Embedding-2B-Quantized

Memory Requirements

PrecisionWeights in memory
As published1.9 GB
16-bit4.4 GB
8-bit2.2 GB
4-bit1.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About kb-wemm-embedding-2b-mlx-mixed

How much GPU memory does kb-wemm-embedding-2b-mlx-mixed need?

About 5.3 GB at 16-bit and 1.3 GB at 4-bit: the weights (2.2B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run kb-wemm-embedding-2b-mlx-mixed on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is kb-wemm-embedding-2b-mlx-mixed released under?

other, as its publisher declares it. Read the license text before commercial use.

What is kb-wemm-embedding-2b-mlx-mixed's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Feature extraction

tiny-audio-granite-qwen

Alex Kroman

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Open weights 1.9B parameters transformers

Model · Feature extraction

jina-embeddings-v5-omni-small

Jina AI

Average score vs. parameter count across image (MIEB-Lite), video (MMEB-V), and audio (MAEB) benchmarks — jina-v5-omni-nano and jina-v5-omni-small define the open-weight frontier (Table 1 in the ArXiv report). jina-embeddings-v5-omni-small is a multimodal embedding model that accepts text, images, video, and audio and produces embeddings in a shared vector space aligned with the text-only jinaai/jina-embeddings-v5-text-small — so you can index with text and query with any modality, no reindexing. For a more compact alternative, see jinaai/jina-embeddings-v5-omni-nano. This is the base repository — it holds all task adapters (retrieval, classification, clustering, text-matching). For a…

Open weights cc-by-nc-4.0 1.6B parameters 32,768 tokens transformers

Model · Feature extraction

MicroGlot

Athan Zhaohong Li

A taxonomy-informed sparse DNA foundation model for microbial genomics. MicroGlot is a 23-layer decoder-only mixture-of-experts transformer pretrained on 378.3 billion nucleotides from 3.70 million sequences across 99,700 microbial species, spanning bacteria, archaea, fungi, protists, viruses and plasmids. It encodes the taxonomic hierarchy as hyperbolic (Poincaré) embeddings and uses them both as an input token and to steer expert routing. Paper: A Taxonomy-Informed Sparse DNA Foundation Model for Microbial Genomics\ A species is known if it is one of the 99,700 pretraining species (check with tokenizer.hasspecies(name)). For taxonomic classification tasks, use MicroGlot-plain, as…

Open weights cc-by-4.0 3B parameters transformers

Model · Feature extraction

Vela-1.0-Omni-Mini

vLLM Semantic Router

Text, images, speech and environmental sounds in one embedding space. Vela Omni Mini supports multimodal search, routing and clustering with normalized vectors that can be compared directly. Scores are 0–100; higher is better. The comparison uses the same held-out evaluation examples, complete retrieval pools and 128-token text cap for both models. Bold marks improvement over the original large model. These known test pools are reused across releases. The common protocol uses labeled TRAIN prototypes for text classification and all matching positives for retrieval; it is separate from official MTEB classification. All 14 metrics, Macro-F1, exact counts and uncertainty. The primary metric…

Open weights apache-2.0 1.4B parameters pytorch

Dense retriever for patent prior-art search (abstract → abstract), fine-tuned from on patent-family pairs (same invention filed in different jurisdictions / languages). Trained for Korean ↔ English cross-lingual and monolingual patent retrieval. Do not use the base model's asymmetric convention (query: / passage: ). It raises no error but silently degrades retrieval quality, because training was symmetric. corpus (other family members masked; one relevant document per query). crosssame: translation pairs (KR↔EN), crosssimilar: cross-lingual same-family non-translation pairs, monosimilar: monolingual same-family pairs. Scores on the 50k-document subset; full-corpus (209,671 documents)…

Open weights other 1.1B parameters 262,144 tokens sentence-transformers

Model Type: Feature backbone; Params: 1136M (giant); Image size: 224 x 224 x 3; Patch size: 14 x 14 x 3; Repository: github.com:marrlab/DinoBloom; Original Weights: Zenodo.

Open weights apache-2.0 1.1B parameters timm