EmbeddingGemma 2 is an open multimodal embedding model built by Google DeepMind which maps text (incl. code), images, video, and audio inputs—and combinations thereof—into a single, unified 768-dimensional vector space. The model has 740M total parameters, combining a 270M parameter text model with modular vision (170M) and audio (300M) encoders. Designed to run on consumer hardware such as mobile devices and laptops, EmbeddingGemma 2 delivers low-latency semantic representations for on-device applications, like search, retrieval-augmented generation (RAG), classification, and clustering. EmbeddingGemma 2 builds upon the architectural and capability advancements of Gemma 4, offering several…
Open-weight model · Feature extraction
embeddinggemma-2-oQ6e
by Jun Kim Jundot/embeddinggemma-2-oQ6e
embeddinggemma-2-oQ6e is an open-weight model for feature extraction from Jun Kim, released under Apache License 2.0. It has 744M parameters and a 262,144-token context. At 16-bit it needs about 1.8 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.
This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385).
Runs On
What it takes to serve embeddinggemma-2-oQ6e (744M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 1.5 GB | 1.8 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 0.7 GB | 0.9 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.4 GB | 0.4 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.
embeddinggemma-2-oQ6e on every accelerator the SAVRN Index prices, at every precision
Model Card
By Jun Kim, published under apache-2.0, revision 2213621a4385.
This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385). A mixed-precision MLX checkpoint of google/embeddinggemma-2, Google DeepMind's multimodal embedding model that maps text, images, video and audio into one 768-dimensional vector space. It includes the text encoder, the vision encoder and the audio encoder. oQ quantizes the text encoder; the vision and audio encoders stay in BF16. oMLX serves text and image inputs through POST /v1/embeddings (jundot/omlx#4333) and does not load the audio encoder. The effective average is 12.702 bits/weight for the complete checkpoint. oQ6e allocates bits by measured layer…
Read Jun Kim's full model card
This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385).
A mixed-precision MLX checkpoint of google/embeddinggemma-2, Google DeepMind's multimodal embedding model that maps text, images, video and audio into one 768-dimensional vector space. It includes the text encoder, the vision encoder and the audio encoder. oQ quantizes the text encoder; the vision and audio encoders stay in BF16.
oMLX serves text and image inputs through POST /v1/embeddings (jundot/omlx#4333) and does not load the audio encoder.
The effective average is 12.702 bits/weight for the complete checkpoint.
Quantization and Bit Distribution
oQ6e allocates bits by measured layer sensitivity, then rounds each group with an importance matrix (128 samples x 512 tokens) and a weighted least-squares refit of its scale and bias.
| Storage format | Logical weights | Share of total | Tensor storage | Effective bits/weight |
|---|---|---|---|---|
| Affine 6-bit, group 64 | 0.207B | 27.821% | 0.157 GiB | 6.50 |
| Affine 8-bit, group 64 | 0.065B | 8.734% | 0.064 GiB | 8.50 |
| BF16 | 0.472B | 63.445% | 0.880 GiB | 16.00 |
| Total | 0.744B | 100% | 1.101 GiB | 12.702 |
Storage Breakdown
| Component | Logical weights | Storage |
|---|---|---|
| Text encoder | 0.272B | 0.237 GB / 0.221 GiB |
| Vision encoder | 0.167B | 0.335 GB / 0.312 GiB |
| Audio encoder | 0.305B | 0.610 GB / 0.568 GiB |
| Total | 0.744B | 1.182 GB / 1.101 GiB |
License
Apache-2.0, following the source model. See LICENSE.
Configuration
- Architecture
- EmbeddingGemma2Model
- Context length (tokens)
- 262,144
- Layers
- 24
- Hidden size
- 512
- Feed-forward size
- 2,048
- Attention heads
- 4
- Key/value heads
- 2
- Head dimension
- 256
- Vocabulary size
- 262,144
- Sliding window (tokens)
- 512
- Model type
- embedding_gemma2
Identity and Version
- Repository
- Jundot/embeddinggemma-2-oQ6e
- Publisher
- Jun Kim
- Task
- Feature extraction
- Modality
- Text
- Library
- mlx
- Parameters
- 744M parameters
- Languages
- mlx, oq
- Revision
- 2213621a438558c7efa2fefafad9d216edf03070
- First published
- 2026-10-13
- Last updated
- 2026-10-13
Files and Weights
12 files, 1.2 GB in total. The weights are 1 file totalling 1.2 GB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors | Weights | 1.2 GB | 35e5d1ddbc2b |
| config.json | Configuration | 31.3 KB | — |
| oq_imatrix_report.json | Configuration | 14.2 KB | — |
| preprocessor_config.json | Configuration | 511 B | — |
| processor_config.json | Configuration | 1.8 KB | — |
| LICENSE | Documentation | 11.4 KB | — |
| README.md | Documentation | 2.0 KB | — |
| chat_template.jinja | Other | 1.0 KB | — |
| .gitattributes | Repository | 1.6 KB | — |
| tokenizer.json | Tokenizer | 32.2 MB | 4d777ef5bdc1 |
| tokenizer.model | Tokenizer | 4.7 MB | e594c8a90eb0 |
| tokenizer_config.json | Tokenizer | 1.6 KB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 1.2 GB
Released by Jun Kim through its official repository on Hugging Face. Read the license.
Built From
- Derived from google/embeddinggemma-2
- Quantized from google/embeddinggemma-2
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 1.2 GB |
| 16-bit | 1.5 GB |
| 8-bit | 0.7 GB |
| 4-bit | 0.4 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About embeddinggemma-2-oQ6e
How much GPU memory does embeddinggemma-2-oQ6e need?
About 1.8 GB at 16-bit and 0.4 GB at 4-bit: the weights (744M parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run embeddinggemma-2-oQ6e on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use embeddinggemma-2-oQ6e commercially?
Yes. embeddinggemma-2-oQ6e is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
What is embeddinggemma-2-oQ6e's context length?
262,144 tokens, from the maximum position embeddings in its published configuration.
Similar Models
This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385). A mixed-precision MLX checkpoint of google/embeddinggemma-2, Google DeepMind's multimodal embedding model that maps text, images, video and audio into one 768-dimensional vector space. It includes the text encoder, the vision encoder and the audio encoder. oQ quantizes the text encoder; the vision and audio encoders stay in BF16. oMLX serves text and image inputs through POST /v1/embeddings (jundot/omlx#4333) and does not load the audio encoder. The effective average is 13.258 bits/weight for the complete checkpoint. oQ8e allocates bits by measured layer…
This model was quantized using oQ (oMLX v0.7.1) mixed-precision quantization with Improved oQe Quantization (jundot/omlx#4385). A mixed-precision MLX checkpoint of google/embeddinggemma-2, Google DeepMind's multimodal embedding model that maps text, images, video and audio into one 768-dimensional vector space. It includes the text encoder, the vision encoder and the audio encoder. oQ quantizes the text encoder; the vision and audio encoders stay in BF16. oMLX serves text and image inputs through POST /v1/embeddings (jundot/omlx#4333) and does not load the audio encoder. The effective average is 11.991 bits/weight for the complete checkpoint. oQ4e allocates bits by measured layer…
A lightweight standalone audio feature extractor derived from Voxtral-Mini-3B-2507. This repository isolates the Whisper-based audio encoder and multi-modal projector from the original 3B language model. The extracted module is intended for offline audio preprocessing, dataset preparation, feature caching, and downstream multimodal training pipelines. The language-model decoder is not included. It does not contain the 3B LLaMA language-model decoder. For offline preprocessing, loading the complete multimodal language model is unnecessary when the only required output is the projected audio representation. This standalone checkpoint can therefore be used as a dedicated audio feature…
CoVisco-L-14 is the Stage 1 vision encoder of the CoVisco pipeline (Codec-Native Vision Encoder with Native Token Compression for Efficient Unified Visual Understanding). It encodes images and videos in a unified way and is trained by SigLIP-style distillation against two teacher branches. This repository releases only the vision-encoder weights in the safe.safetensors format, together with the minimal model code and a self-contained loader. The model is a transformers.PreTrainedModel and is loadable via frompretrained (see below). - 4D RoPE (ropetheta=10000) for spatio-temporal positions - Three projection heads (each LayerNorm + Linear, output L2-normalized): - toimagecaption → 1536-d…
The Qwen3 Embedding model series is the latest proprietary model of the Qwen family, specifically designed for text embedding and ranking tasks. Building upon the dense foundational models of the Qwen3 series, it provides a comprehensive range of text embeddings and reranking models in various sizes (0.6B, 4B, and 8B). This series inherits the exceptional multilingual capabilities, long-text understanding, and reasoning skills of its foundational model. The Qwen3 Embedding series represents significant advancements in multiple text embedding and ranking tasks, including text retrieval, code retrieval, text classification, text clustering, and bitext mining. Exceptional Versatility: The…