SAVRN
Search Contact SAVRN

Open-weight model · Zero shot image classification

siglip-so400m-patch14-384

by Google google/siglip-so400m-patch14-384

SigLIP model pre-trained on WebLi at resolution 384x384. It was introduced in the paper Sigmoid Loss for Language Image Pre-Training by Zhai et al. and first released in this repository.

Parameters878M
Context
Weights3.5 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads1.3M

Runs On

What it takes to serve siglip-so400m-patch14-384 (878M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 1.8 GB 2.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.9 GB 1.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.4 GB 0.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on siglip-so400m-patch14-384

Two point one gigabytes. That is the whole running footprint of this SigLIP image-text model at 16-bit, and the cheapest slot we price it on is one MI300X with 192 GB at $1.85 an hour on demand. Nearly the whole card sits idle, so run it beside other work. Its job is zero-shot image classification at a 384 by 384 input, using a sigmoid loss instead of the usual CLIP objective; 8-bit needs 1.1 GB and 4-bit 0.5 GB.

Apache 2.0 permits commercial use, modification and redistribution with a patent grant, so product use is uncomplicated. The team that released SigLIP did not write its model card, so the three papers listed for it, arXiv:2303.15343, 2305.13035 and 2209.06794, are the primary reference. The weights are stored in float32, 3.5 GB across nine files, so budget the download at that size and convert down yourself.

Model Card

By Google, published under apache-2.0, revision 9fdffc58afc9.

SigLIP (shape-optimized model)

SigLIP model pre-trained on WebLi at resolution 384x384. It was introduced in the paper Sigmoid Loss for Language Image Pre-Training by Zhai et al. and first released in this repository.

This model has the SoViT-400m architecture, which is the shape-optimized version as presented in Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Design by Alabdulmohsin et al.

Disclaimer: The team releasing SigLIP did not write a model card for this model so this model card has been written by the Hugging Face team.

Model description

SigLIP is CLIP, a multimodal model, with a better loss function. The sigmoid loss operates solely on image-text pairs and does not require a global view of the pairwise similarities for normalization. This allows further scaling up the batch size, while also performing better at smaller batch sizes.

A TLDR of SigLIP by one of the authors can be found here.

Intended uses & limitations

Read the full model card (452 words)

Configuration

Architecture
SiglipModel
Layers
27
Hidden size
1,152
Feed-forward size
4,304
Attention heads
16
Stored precision
float32
Model type
siglip

Identity and Version

Repository
google/siglip-so400m-patch14-384
Publisher
Google
Task
Zero shot image classification
Modality
Other
Library
transformers
Parameters
878M parameters
Languages
Not stated by the source
Revision
9fdffc58afc957d1a03a25b10dba0329ab15c2a3
First published
2024-01-08
Last updated
2024-09-26

Files and Weights

9 files, 3.5 GB in total. The weights are 1 file totalling 3.5 GB in safetensors.

Weights1 file · 3.5 GB
Configuration3 files · 1.4 KB
Tokenizer3 files · 3.2 MB
Documentation1 file · 4.3 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights3.5 GB ea2abad2b7f8
config.jsonConfiguration576 B
preprocessor_config.jsonConfiguration368 B
special_tokens_map.jsonConfiguration409 B
README.mdDocumentation4.3 KB
.gitattributesRepository1.5 KB
spiece.modelTokenizer798.3 KB 1e5036bed065
tokenizer.jsonTokenizer2.4 MB
tokenizer_config.jsonTokenizer711 B

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
3.5 GB
Download from Google

Released by Google through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published3.5 GB
16-bit1.8 GB
8-bit0.9 GB
4-bit0.4 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Compare siglip-so400m-patch14-384

Questions About siglip-so400m-patch14-384

How much GPU memory does siglip-so400m-patch14-384 need?

About 2.1 GB at 16-bit and 0.5 GB at 4-bit: the weights (878M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run siglip-so400m-patch14-384 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use siglip-so400m-patch14-384 commercially?

Yes. siglip-so400m-patch14-384 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Zero shot image classification

siglip2-so400m-patch14-384

Google

SigLIP 2 extends the pretraining objective of SigLIP with prior, independently developed techniques into a unified recipe, for improved semantic understanding, localization, and dense features. You can use the raw model for tasks like zero-shot image classification and image-text retrieval, or as a vision encoder for VLMs (and other vision tasks). Here is how to use this model to perform zero-shot image classification: You can encode an image using the Vision Tower like so: For more code examples, we refer to the siglip documentation. SigLIP 2 adds some clever training objectives on top of SigLIP: SigLIP 2 is pre-trained on the WebLI dataset (Chen et al., 2023). The model was trained on up…

Open weights apache-2.0 1.1B parameters transformers

Model · Zero shot image classification

clip-vit-large-patch14

OpenAI

Disclaimer: The model card is taken and modified from the official CLIP repository, it can be found here. The CLIP model was developed by researchers at OpenAI to learn about what contributes to robustness in computer vision tasks. The model was also developed to test the ability of models to generalize to arbitrary image classification tasks in a zero-shot manner. It was not developed for general model deployment - to deploy models like CLIP, researchers will first need to carefully study their capabilities in relation to the specific context they’re being deployed within. January 2021 The base model uses a ViT-L/14 Transformer architecture as an image encoder and uses a masked…

Open weights 428M parameters 77 tokens transformers

Model · Zero shot image classification

CLIP-ViT-L-14-laion2B-s32B-b82K

LAION eV

A CLIP ViT L/14 model trained with the LAION-2B English subset of LAION-5B (https://laion.ai/blog/laion-5b/) using OpenCLIP (https://github.com/mlfoundations/openclip). Model training ('babysitting') done by Ross Wightman on the JUWELS Booster supercomputer. See acknowledgements below. As per the original OpenAI CLIP model card, this model is intended as a research output for research communities. We hope that this model will enable researchers to better understand and explore zero-shot, arbitrary image classification. We also hope it can be used for interdisciplinary studies of the potential impact of such model. The OpenAI CLIP paper includes a discussion of potential downstream impacts…

Open weights mit 428M parameters 77 tokens open_clip

Model · Zero shot image classification

siglip2-base-patch16-256

Google

SigLIP 2 extends the pretraining objective of SigLIP with prior, independently developed techniques into a unified recipe, for improved semantic understanding, localization, and dense features. You can use the raw model for tasks like zero-shot image classification and image-text retrieval, or as a vision encoder for VLMs (and other vision tasks). Here is how to use this model to perform zero-shot image classification: You can encode an image using the Vision Tower like so: For more code examples, we refer to the siglip documentation. SigLIP 2 adds some clever training objectives on top of SigLIP: SigLIP 2 is pre-trained on the WebLI dataset (Chen et al., 2023). The model was trained on up…

Open weights apache-2.0 375M parameters transformers

Model · Zero shot image classification

siglip2-base-patch16-naflex

Google

SigLIP 2 extends the pretraining objective of SigLIP with prior, independently developed techniques into a unified recipe, for improved semantic understanding, localization, and dense features. You can use the raw model for tasks like zero-shot image classification and image-text retrieval, or as a vision encoder for VLMs (and other vision tasks). Here is how to use this model to perform zero-shot image classification: You can encode an image using the Vision Tower like so: For more code examples, we refer to the siglip2 documentation. SigLIP 2 adds some clever training objectives on top of SigLIP: SigLIP 2 is pre-trained on the WebLI dataset (Chen et al., 2023). The model was trained on up…

Open weights apache-2.0 375M parameters transformers

Model · Zero shot image classification

siglip2-base-patch16-224

Google

SigLIP 2 extends the pretraining objective of SigLIP with prior, independently developed techniques into a unified recipe, for improved semantic understanding, localization, and dense features. You can use the raw model for tasks like zero-shot image classification and image-text retrieval, or as a vision encoder for VLMs (and other vision tasks). Here is how to use this model to perform zero-shot image classification: You can encode an image using the Vision Tower like so: For more code examples, we refer to the siglip documentation. SigLIP 2 adds some clever training objectives on top of SigLIP: SigLIP 2 is pre-trained on the WebLI dataset (Chen et al., 2023). The model was trained on up…

Open weights apache-2.0 375M parameters transformers