SAVRN
Search Contact SAVRN

Open-weight model · Image feature extraction

vit-base-patch16-224-in21k

by Google google/vit-base-patch16-224-in21k

Vision Transformer (ViT) model pre-trained on ImageNet-21k (14 million images, 21,843 classes) at resolution 224x224. It was introduced in the paper An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale by Dosovitskiy et al.

Parameters86M
Context
Weights1.4 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads1.8M

Runs On

What it takes to serve vit-base-patch16-224-in21k (86M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.2 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on vit-base-patch16-224-in21k

Released in March 2022, this one does image feature extraction: 86M parameters, pre-trained on ImageNet-21k at 224 by 224, 14 million images across 21,843 classes. Memory is a non-issue at 0.2 GB in 16-bit, and 4-bit weights round to 0.0 GB, so skip quantizing. The cheapest Index setup, one MI300X with 192 GB at $1.85 an hour on demand, bills by the hour, so throughput, not fit, is the whole question.

Apache 2.0 covers commercial use, modification and redistribution with a patent grant; keep the notices and state significant changes. There is no context length and no host token price on the Index, since it produces features, not tokens. The weights ship in safetensors, pytorch, jax and tf, and the releasing team did not write the model card, so the paper, An Image is Worth 16x16 Words, is the reference to read before you wire it in.

Model Card

By Google, published under apache-2.0, revision b4569560a39a.

Vision Transformer (base-sized model)

Vision Transformer (ViT) model pre-trained on ImageNet-21k (14 million images, 21,843 classes) at resolution 224x224. It was introduced in the paper An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale by Dosovitskiy et al. and first released in this repository. However, the weights were converted from the timm repository by Ross Wightman, who already converted the weights from JAX to PyTorch. Credits go to him.

Disclaimer: The team releasing ViT did not write a model card for this model so this model card has been written by the Hugging Face team.

Model description

The Vision Transformer (ViT) is a transformer encoder model (BERT-like) pretrained on a large collection of images in a supervised fashion, namely ImageNet-21k, at a resolution of 224x224 pixels.

Read the full model card (659 words)

Configuration

Architecture
ViTModel
Layers
12
Hidden size
768
Feed-forward size
3,072
Attention heads
12
Model type
vit

Identity and Version

Repository
google/vit-base-patch16-224-in21k
Publisher
Google
Task
Image feature extraction
Modality
Other
Library
transformers
Parameters
86M parameters
Languages
tf, jax, vit
Revision
b4569560a39a0f1af58e3ddaf17facf20ab919b0
First published
2022-03-02
Last updated
2024-02-05

Files and Weights

8 files, 1.4 GB in total. The weights are 4 files totalling 1.4 GB in bin, h5, msgpack, safetensors.

Weights4 files · 1.4 GB
Configuration2 files · 662 B
Documentation1 file · 5.4 KB
Repository1 file · 744 B
Every file
FileTypeSizeSHA-256
flax_model.msgpackWeights345.6 MB aa00da5f7abb
model.safetensorsWeights345.6 MB fd4e1169c7aa
pytorch_model.binWeights345.6 MB 84066da0f5d8
tf_model.h5Weights345.8 MB 1f76b72dc4a8
config.jsonConfiguration502 B
preprocessor_config.jsonConfiguration160 B
README.mdDocumentation5.4 KB
.gitattributesRepository744 B

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
1.4 GB
Download from Google

Released by Google through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published1.4 GB
16-bit0.2 GB
8-bit0.1 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Compare vit-base-patch16-224-in21k

Questions About vit-base-patch16-224-in21k

How much GPU memory does vit-base-patch16-224-in21k need?

About 0.2 GB at 16-bit and 0.1 GB at 4-bit: the weights (86M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run vit-base-patch16-224-in21k on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use vit-base-patch16-224-in21k commercially?

Yes. vit-base-patch16-224-in21k is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Image feature extraction

dinov2-base

AI at Meta

Vision Transformer (ViT) model trained using the DINOv2 method. It was introduced in the paper DINOv2: Learning Robust Visual Features without Supervision by Oquab et al. and first released in this repository. Disclaimer: The team releasing DINOv2 did not write a model card for this model so this model card has been written by the Hugging Face team. The Vision Transformer (ViT) is a transformer encoder model (BERT-like) pretrained on a large collection of images in a self-supervised fashion. Images are presented to the model as a sequence of fixed-size patches, which are linearly embedded. One also adds a [CLS] token to the beginning of a sequence to use it for classification tasks. One…

Open weights apache-2.0 87M parameters transformers

Model · Image feature extraction

dinov2-small

AI at Meta

Vision Transformer (ViT) model trained using the DINOv2 method. It was introduced in the paper DINOv2: Learning Robust Visual Features without Supervision by Oquab et al. and first released in this repository. Disclaimer: The team releasing DINOv2 did not write a model card for this model so this model card has been written by the Hugging Face team. The Vision Transformer (ViT) is a transformer encoder model (BERT-like) pretrained on a large collection of images in a self-supervised fashion. Images are presented to the model as a sequence of fixed-size patches, which are linearly embedded. One also adds a [CLS] token to the beginning of a sequence to use it for classification tasks. One…

Open weights apache-2.0 22M parameters transformers

Model · Image feature extraction

vit_small_patch14_dinov2.lvd142m

PyTorch Image Models

A Vision Transformer (ViT) image feature model. Pretrained on LVD-142M with self-supervised DINOv2 method. - An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale: https://arxiv.org/abs/2010.11929v2 Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 22M parameters timm

Model · Image feature extraction

dinov3-vitl16-pretrain-lvd1689m

Camenduru

DINOv3 is a family of versatile vision foundation models that outperforms the specialized state of the art across a broad range of settings, without fine-tuning. DINOv3 produces high-quality dense features that achieve outstanding performance on various vision tasks, significantly surpassing previous self- and weakly-supervised foundation models. These are Vision Transformer and ConvNeXt models trained following the method described in the DINOv3 paper. 12 models are provided: - 10 models pretrained on web data (LVD-1689M dataset) - 1 ViT-7B trained from scratch, - 5 ViT-S/S+/B/L/H+ models distilled from the ViT-7B, - 4 ConvNeXt-{T/S/B/L} models distilled from the ViT-7B, - 2 models…

Open weights other 303M parameters transformers

Model · Image feature extraction

dinov2-large

AI at Meta

Vision Transformer (ViT) model trained using the DINOv2 method. It was introduced in the paper DINOv2: Learning Robust Visual Features without Supervision by Oquab et al. and first released in this repository. Disclaimer: The team releasing DINOv2 did not write a model card for this model so this model card has been written by the Hugging Face team. The Vision Transformer (ViT) is a transformer encoder model (BERT-like) pretrained on a large collection of images in a self-supervised fashion. Images are presented to the model as a sequence of fixed-size patches, which are linearly embedded. One also adds a [CLS] token to the beginning of a sequence to use it for classification tasks. One…

Open weights apache-2.0 304M parameters transformers