Skip to page content
SAVRN
Search Plan a project

Open-weight model · Feature extraction

embeddinggemma-2-oQ6e

by Jun Kim Jundot/embeddinggemma-2-oQ6e

embeddinggemma-2-oQ6e is an open-weight model for feature extraction from Jun Kim, released under Apache License 2.0. It has 744M parameters and a 262,144-token context. At 16-bit it needs about 1.8 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385).

Parameters744M
Context262,144
Weights1.2 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve embeddinggemma-2-oQ6e (744M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 1.5 GB 1.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.7 GB 0.9 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.4 GB 0.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

embeddinggemma-2-oQ6e on every accelerator the SAVRN Index prices, at every precision

Model Card

By Jun Kim, published under apache-2.0, revision 2213621a4385.

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385). A mixed-precision MLX checkpoint of google/embeddinggemma-2, Google DeepMind's multimodal embedding model that maps text, images, video and audio into one 768-dimensional vector space. It includes the text encoder, the vision encoder and the audio encoder. oQ quantizes the text encoder; the vision and audio encoders stay in BF16. oMLX serves text and image inputs through POST /v1/embeddings (jundot/omlx#4333) and does not load the audio encoder. The effective average is 12.702 bits/weight for the complete checkpoint. oQ6e allocates bits by measured layer…

Read Jun Kim's full model card

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385).

A mixed-precision MLX checkpoint of google/embeddinggemma-2, Google DeepMind's multimodal embedding model that maps text, images, video and audio into one 768-dimensional vector space. It includes the text encoder, the vision encoder and the audio encoder. oQ quantizes the text encoder; the vision and audio encoders stay in BF16.

oMLX serves text and image inputs through POST /v1/embeddings (jundot/omlx#4333) and does not load the audio encoder.

The effective average is 12.702 bits/weight for the complete checkpoint.

Quantization and Bit Distribution

oQ6e allocates bits by measured layer sensitivity, then rounds each group with an importance matrix (128 samples x 512 tokens) and a weighted least-squares refit of its scale and bias.

Storage format Logical weights Share of total Tensor storage Effective bits/weight
Affine 6-bit, group 64 0.207B 27.821% 0.157 GiB 6.50
Affine 8-bit, group 64 0.065B 8.734% 0.064 GiB 8.50
BF16 0.472B 63.445% 0.880 GiB 16.00
Total 0.744B 100% 1.101 GiB 12.702

Storage Breakdown

Component Logical weights Storage
Text encoder 0.272B 0.237 GB / 0.221 GiB
Vision encoder 0.167B 0.335 GB / 0.312 GiB
Audio encoder 0.305B 0.610 GB / 0.568 GiB
Total 0.744B 1.182 GB / 1.101 GiB

License

Apache-2.0, following the source model. See LICENSE.

Configuration

Architecture
EmbeddingGemma2Model
Context length (tokens)
262,144
Layers
24
Hidden size
512
Feed-forward size
2,048
Attention heads
4
Key/value heads
2
Head dimension
256
Vocabulary size
262,144
Sliding window (tokens)
512
Model type
embedding_gemma2

Identity and Version

Repository
Jundot/embeddinggemma-2-oQ6e
Publisher
Jun Kim
Task
Feature extraction
Modality
Text
Library
mlx
Parameters
744M parameters
Languages
mlx, oq
Revision
2213621a438558c7efa2fefafad9d216edf03070
First published
2026-10-13
Last updated
2026-10-13

Files and Weights

12 files, 1.2 GB in total. The weights are 1 file totalling 1.2 GB in safetensors.

Weights1 file · 1.2 GB
Configuration4 files · 47.8 KB
Tokenizer3 files · 36.9 MB
Documentation2 files · 13.4 KB
Other1 file · 1.0 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.2 GB 35e5d1ddbc2b
config.jsonConfiguration31.3 KB —
oq_imatrix_report.jsonConfiguration14.2 KB —
preprocessor_config.jsonConfiguration511 B —
processor_config.jsonConfiguration1.8 KB —
LICENSEDocumentation11.4 KB —
README.mdDocumentation2.0 KB —
chat_template.jinjaOther1.0 KB —
.gitattributesRepository1.6 KB —
tokenizer.jsonTokenizer32.2 MB 4d777ef5bdc1
tokenizer.modelTokenizer4.7 MB e594c8a90eb0
tokenizer_config.jsonTokenizer1.6 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
1.2 GB
Download from Jun Kim

Released by Jun Kim through its official repository on Hugging Face. Read the license.

Built From

  • Derived from google/embeddinggemma-2
  • Quantized from google/embeddinggemma-2

Memory Requirements

PrecisionWeights in memory
As published1.2 GB
16-bit1.5 GB
8-bit0.7 GB
4-bit0.4 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About embeddinggemma-2-oQ6e

How much GPU memory does embeddinggemma-2-oQ6e need?

About 1.8 GB at 16-bit and 0.4 GB at 4-bit: the weights (744M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run embeddinggemma-2-oQ6e on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use embeddinggemma-2-oQ6e commercially?

Yes. embeddinggemma-2-oQ6e is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is embeddinggemma-2-oQ6e's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Feature extraction

embeddinggemma-2

Thomas Miller

EmbeddingGemma 2 is an open multimodal embedding model built by Google DeepMind which maps text (incl. code), images, video, and audio inputs—and combinations thereof—into a single, unified 768-dimensional vector space. The model has 740M total parameters, combining a 270M parameter text model with modular vision (170M) and audio (300M) encoders. Designed to run on consumer hardware such as mobile devices and laptops, EmbeddingGemma 2 delivers low-latency semantic representations for on-device applications, like search, retrieval-augmented generation (RAG), classification, and clustering. EmbeddingGemma 2 builds upon the architectural and capability advancements of Gemma 4, offering several…

Open weights apache-2.0 744M parameters 262,144 tokens transformers

Model · Feature extraction

embeddinggemma-2-oQ8e

Jun Kim

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385). A mixed-precision MLX checkpoint of google/embeddinggemma-2, Google DeepMind's multimodal embedding model that maps text, images, video and audio into one 768-dimensional vector space. It includes the text encoder, the vision encoder and the audio encoder. oQ quantizes the text encoder; the vision and audio encoders stay in BF16. oMLX serves text and image inputs through POST /v1/embeddings (jundot/omlx#4333) and does not load the audio encoder. The effective average is 13.258 bits/weight for the complete checkpoint. oQ8e allocates bits by measured layer…

Open weights apache-2.0 744M parameters 262,144 tokens mlx

Model · Feature extraction

embeddinggemma-2-oQ4e

Jun Kim

This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385). A mixed-precision MLX checkpoint of google/embeddinggemma-2, Google DeepMind's multimodal embedding model that maps text, images, video and audio into one 768-dimensional vector space. It includes the text encoder, the vision encoder and the audio encoder. oQ quantizes the text encoder; the vision and audio encoders stay in BF16. oMLX serves text and image inputs through POST /v1/embeddings (jundot/omlx#4333) and does not load the audio encoder. The effective average is 11.991 bits/weight for the complete checkpoint. oQ4e allocates bits by measured layer…

Open weights apache-2.0 744M parameters 262,144 tokens mlx

Model · Feature extraction

voxtral-mini-audio-extractor

Vxltxr Llc

A lightweight standalone audio feature extractor derived from Voxtral-Mini-3B-2507. This repository isolates the Whisper-based audio encoder and multi-modal projector from the original 3B language model. The extracted module is intended for offline audio preprocessing, dataset preparation, feature caching, and downstream multimodal training pipelines. The language-model decoder is not included. It does not contain the 3B LLaMA language-model decoder. For offline preprocessing, loading the complete multimodal language model is unnecessary when the only required output is the projected audio representation. This standalone checkpoint can therefore be used as a dedicated audio feature…

Open weights apache-2.0 662M parameters

Model · Feature extraction

CoVisco-L-14

Ernie Research

CoVisco-L-14 is the Stage 1 vision encoder of the CoVisco pipeline (Codec-Native Vision Encoder with Native Token Compression for Efficient Unified Visual Understanding). It encodes images and videos in a unified way and is trained by SigLIP-style distillation against two teacher branches. This repository releases only the vision-encoder weights in the safe.safetensors format, together with the minimal model code and a self-contained loader. The model is a transformers.PreTrainedModel and is loadable via frompretrained (see below). - 4D RoPE (ropetheta=10000) for spatio-temporal positions - Three projection heads (each LayerNorm + Linear, output L2-normalized): - toimagecaption → 1536-d…

Open weights mit 639M parameters pytorch

Model · Feature extraction

Qwen3-Embedding-0.6B

Qwen

The Qwen3 Embedding model series is the latest proprietary model of the Qwen family, specifically designed for text embedding and ranking tasks. Building upon the dense foundational models of the Qwen3 series, it provides a comprehensive range of text embeddings and reranking models in various sizes (0.6B, 4B, and 8B). This series inherits the exceptional multilingual capabilities, long-text understanding, and reasoning skills of its foundational model. The Qwen3 Embedding series represents significant advancements in multiple text embedding and ranking tasks, including text retrieval, code retrieval, text classification, text clustering, and bitext mining. Exceptional Versatility: The…

Open weights apache-2.0 596M parameters 32,768 tokens sentence-transformers