SAVRN
Search Contact SAVRN

Open-weight model · Image segmentation

clipseg-rd64

by CAMPUS INSTITUTE DATA SCIENCE (CIDAS) CIDAS/clipseg-rd64

CLIPSeg model with reduce dimension 64. It was introduced in the paper Image Segmentation Using Text and Image Prompts by Lüddecke et al. and first released in this repository. This model is intended for zero-shot and one-shot image segmentation.

Parameters151M
Context77
Weights1.2 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads14.3k

Runs On

What it takes to serve clipseg-rd64 (151M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.3 GB 0.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.2 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By CAMPUS INSTITUTE DATA SCIENCE (CIDAS), published under apache-2.0, revision 1c75af8363f2.

CLIPSeg model with reduce dimension 64. It was introduced in the paper Image Segmentation Using Text and Image Prompts by Lüddecke et al. and first released in this repository. This model is intended for zero-shot and one-shot image segmentation. Refer to the documentation.

Read CAMPUS INSTITUTE DATA SCIENCE (CIDAS)'s full model card

CLIPSeg model

CLIPSeg model with reduce dimension 64. It was introduced in the paper Image Segmentation Using Text and Image Prompts by Lüddecke et al. and first released in this repository.

Intended use cases

This model is intended for zero-shot and one-shot image segmentation.

Usage

Refer to the documentation.

Configuration

Architecture
CLIPSegForImageSegmentation
Context length (tokens)
77
Layers
12
Hidden size
512
Feed-forward size
2,048
Attention heads
8
Vocabulary size
49,408
Stored precision
float32
Model type
clipseg

Identity and Version

Repository
CIDAS/clipseg-rd64
Publisher
CAMPUS INSTITUTE DATA SCIENCE (CIDAS)
Task
Image segmentation
Modality
Image
Library
transformers
Parameters
151M parameters
Languages
Not stated by the source
Revision
1c75af8363f2e54e41c15e5dc00775314ee6b79a
First published
2022-11-04
Last updated
2024-11-06

Files and Weights

10 files, 1.2 GB in total. The weights are 2 files totalling 1.2 GB in bin, safetensors.

Weights2 files · 1.2 GB
Configuration3 files · 5.6 KB
Tokenizer3 files · 1.6 MB
Documentation1 file · 552 B
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights602.8 MB 2e166d09082e
pytorch_model.binWeights602.9 MB 63e3e34334d7
config.jsonConfiguration4.7 KB
preprocessor_config.jsonConfiguration379 B
special_tokens_map.jsonConfiguration472 B
README.mdDocumentation552 B
.gitattributesRepository1.5 KB
merges.txtTokenizer524.6 KB
tokenizer_config.jsonTokenizer974 B
vocab.jsonTokenizer1.1 MB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
1.2 GB
Download from CAMPUS INSTITUTE DATA SCIENCE (CIDAS)

Released by CAMPUS INSTITUTE DATA SCIENCE (CIDAS) through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published1.2 GB
16-bit0.3 GB
8-bit0.2 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About clipseg-rd64

How much GPU memory does clipseg-rd64 need?

About 0.4 GB at 16-bit and 0.1 GB at 4-bit: the weights (151M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run clipseg-rd64 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use clipseg-rd64 commercially?

Yes. clipseg-rd64 is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is clipseg-rd64's context length?

77 tokens, from the maximum position embeddings in its published configuration.

Similar Models

CLIPSeg model with reduce dimension 64, refined (using a more complex convolution). It was introduced in the paper Image Segmentation Using Text and Image Prompts by Lüddecke et al. and first released in this repository. This model is intended for zero-shot and one-shot image segmentation. Refer to the documentation.

Open weights apache-2.0 151M parameters 77 tokens transformers

Model · Image segmentation

mask2former-swin-base-ade-semantic

AI at Meta

Mask2Former model trained on ADE20k semantic segmentation (base-sized version, Swin backbone). It was introduced in the paper Masked-attention Mask Transformer for Universal Image Segmentation and first released in this repository. Disclaimer: The team releasing Mask2Former did not write a model card for this model so this model card has been written by the Hugging Face team. Mask2Former addresses instance, semantic and panoptic segmentation with the same paradigm: by predicting a set of masks and corresponding labels. Hence, all 3 tasks are treated as if they were instance segmentation. Mask2Former outperforms the previous SOTA, MaskFormer both in terms of performance an efficiency by (i)…

Open weights other 107M parameters transformers

Model · Image segmentation

mask2former-swin-base-coco-panoptic

AI at Meta

Mask2Former model trained on COCO panoptic segmentation (base-sized version, Swin backbone). It was introduced in the paper Masked-attention Mask Transformer for Universal Image Segmentation and first released in this repository. Disclaimer: The team releasing Mask2Former did not write a model card for this model so this model card has been written by the Hugging Face team. Mask2Former addresses instance, semantic and panoptic segmentation with the same paradigm: by predicting a set of masks and corresponding labels. Hence, all 3 tasks are treated as if they were instance segmentation. Mask2Former outperforms the previous SOTA, MaskFormer both in terms of performance an efficiency by (i)…

Open weights other 107M parameters transformers

Model · Image segmentation

BEN2

Prama LLC

BEN2 (Background Erase Network) introduces a novel approach to foreground segmentation through its innovative Confidence Guided Matting (CGM) pipeline. The architecture employs a refiner network that targets and processes pixels where the base model exhibits lower confidence levels, resulting in more precise and reliable matting results. This model is built on BEN: BEN2 was trained on the DIS5k and our 22K proprietary segmentation dataset. Our enhanced model delivers superior performance in hair matting, 4K processing, object segmentation, and edge refinement. Our Base model is open source. To try the full model through our free web demo or integrate BEN2 into your project with our API…

Open weights mit 95M parameters ben2

Mask2Former model trained on Cityscapes semantic segmentation (large-sized version, Swin backbone). It was introduced in the paper Masked-attention Mask Transformer for Universal Image Segmentation and first released in this repository. Disclaimer: The team releasing Mask2Former did not write a model card for this model so this model card has been written by the Hugging Face team. Mask2Former addresses instance, semantic and panoptic segmentation with the same paradigm: by predicting a set of masks and corresponding labels. Hence, all 3 tasks are treated as if they were instance segmentation. Mask2Former outperforms the previous SOTA, MaskFormer both in terms of performance an efficiency by…

Open weights other 216M parameters transformers

Mask2Former model trained on Mapillary Vistas semantic segmentation (large-sized version, Swin backbone). It was introduced in the paper Masked-attention Mask Transformer for Universal Image Segmentation and first released in this repository. Disclaimer: The team releasing Mask2Former did not write a model card for this model so this model card has been written by the Hugging Face team. Mask2Former addresses instance, semantic and panoptic segmentation with the same paradigm: by predicting a set of masks and corresponding labels. Hence, all 3 tasks are treated as if they were instance segmentation. Mask2Former outperforms the previous SOTA, MaskFormer both in terms of performance an…

Open weights other 216M parameters transformers