SAVRN
Search Contact SAVRN

Open-weight model · Image classification

vit_small_patch16_224.augreg_in21k_ft_in1k

by PyTorch Image Models timm/vit_small_patch16_224.augreg_in21k_ft_in1k

A Vision Transformer (ViT) image classification model. Trained on ImageNet-21k and fine-tuned on ImageNet-1k (with additional augmentation and regularization) in JAX by paper authors, ported to PyTorch by Ross Wightman. - How to train your ViT?

Parameters22M
Context
Weights176.5 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads525.4k

Runs On

What it takes to serve vit_small_patch16_224.augreg_in21k_ft_in1k (22M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on vit_small_patch16_224.augreg_in21k_ft_in1k

Twenty-two million parameters and 176 MB of weight files: that is the whole footprint of this image classifier, and it decides the hardware question for you. At 16-bit it needs 0.1 GB of memory, and at 8-bit or 4-bit our Index rounds the need to zero. The cheapest listed setup, one MI300X with 192 GB at $1.85 per hour on-demand, makes no sense for this model alone; put it on a card that is already serving something larger.

Apache 2.0 permits commercial use, modification and redistribution; you keep the license and copyright notices and any NOTICE file, state significant changes, and you get an express patent grant from contributors. No evaluations are reported for it, so run your own test set. The lineage is training on ImageNet-21k then a fine-tune on ImageNet-1k, done in JAX by the paper authors and ported to PyTorch by Ross Wightman, so load it through timm.

Model Card

By PyTorch Image Models, published under apache-2.0, revision 7e2c55630205.

Model card for vit_small_patch16_224.augreg_in21k_ft_in1k

A Vision Transformer (ViT) image classification model. Trained on ImageNet-21k and fine-tuned on ImageNet-1k (with additional augmentation and regularization) in JAX by paper authors, ported to PyTorch by Ross Wightman.

Model Details

  • Model Type: Image classification / feature backbone
  • Model Stats:
  • Params (M): 22.1
  • GMACs: 4.3
  • Activations (M): 8.2
  • Image size: 224 x 224
  • Papers:
  • How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers: https://arxiv.org/abs/2106.10270
  • An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale: https://arxiv.org/abs/2010.11929v2
  • Dataset: ImageNet-1k
  • Pretrain Dataset: ImageNet-21k
  • Original: https://github.com/google-research/vision_transformer

Model Usage

Image Classification

from urllib.request import urlopen
from PIL import Image
import timm

img = Image.open(urlopen(
    'https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/beignets-task-guide.png'
))

model = timm.create_model('vit_small_patch16_224.augreg_in21k_ft_in1k', pretrained=True)
model = model.eval()

# get model specific transforms (normalization, resize)
data_config = timm.data.resolve_model_data_config(model)
transforms = timm.data.create_transform(**data_config, is_training=False)

output = model(transforms(img).unsqueeze(0))  # unsqueeze single image into batch of 1

top5_probabilities, top5_class_indices = torch.topk(output.softmax(dim=1) * 100, k=5)

Image Embeddings

Read the full model card (369 words)

Identity and Version

Repository
timm/vit_small_patch16_224.augreg_in21k_ft_in1k
Publisher
PyTorch Image Models
Task
Image classification
Modality
Image
Library
timm
Parameters
22M parameters
Languages
Not stated by the source
Revision
7e2c55630205e1266030f18370f4c6ed1a514b52
First published
2022-12-22
Last updated
2025-01-21

Files and Weights

5 files, 176.5 MB in total. The weights are 2 files totalling 176.5 MB in bin, safetensors.

Weights2 files · 176.5 MB
Configuration1 file · 587 B
Documentation1 file · 3.9 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights88.2 MB 79c03c635cdf
pytorch_model.binWeights88.3 MB ce9fa8810cf4
config.jsonConfiguration587 B
README.mdDocumentation3.9 KB
.gitattributesRepository1.5 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
176.5 MB
Download from PyTorch Image Models

Released by PyTorch Image Models through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published176.5 MB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About vit_small_patch16_224.augreg_in21k_ft_in1k

How much GPU memory does vit_small_patch16_224.augreg_in21k_ft_in1k need?

About 0.1 GB at 16-bit and 0 GB at 4-bit: the weights (22M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run vit_small_patch16_224.augreg_in21k_ft_in1k on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use vit_small_patch16_224.augreg_in21k_ft_in1k commercially?

Yes. vit_small_patch16_224.augreg_in21k_ft_in1k is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Image classification

resnet34.a1_in1k

PyTorch Image Models

A ResNet-B image classification model. single layer 7x7 convolution with pooling 1x1 convolution shortcut downsample Trained on ImageNet-1k in timm using recipe template described below. ResNet Strikes Back A1 recipe - Deep Residual Learning for Image Recognition: https://arxiv.org/abs/1512.03385 Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 22M parameters timm

A EfficientNet-v2 image classification model. Trained on ImageNet-21k and fine-tuned on ImageNet-1k in Tensorflow by paper authors, ported to PyTorch by Ross Wightman. Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 22M parameters timm

Model · Image classification

FGVCBoeing737

Chaiyakrit

This model is a fine-tuned version of microsoft/resnet-50 on the imagefolder dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 0.0001 - trainbatchsize: 8 - evalbatchsize: 16 - gradientaccumulationsteps: 2 - totaltrainbatchsize: 16 - lrschedulertype: cosine - numepochs: 20 - labelsmoothingfactor: 0.1 - Transformers 5.16.1 - Pytorch 2.11.0+cu128 - Datasets 4.8.5 - Tokenizers 0.23.1

Open weights apache-2.0 24M parameters transformers

Model · Image classification

regnety_032.ra_in1k

PyTorch Image Models

A RegNetY-3.2GF image classification model. Trained on ImageNet-1k by Ross Wightman in timm. The timm RegNet implementation includes a number of enhancements not present in other implementations, including: stochastic depth gradient checkpointing layer-wise LR decay configurable output stride (dilation) configurable activation and norm layers option for a pre-activation bottleneck block used in RegNetV variant only known RegNetZ model definitions with pretrained weights Explore the dataset and runtime metrics of this model in timm model results. For the comparison summary below, the rain1k, ra3in1k, chin1k, sw, and lion tagged weights are trained in timm.

Open weights apache-2.0 20M parameters timm

Model · Image classification

resnet50_gn.a1h_in1k

PyTorch Image Models

A ResNet-B image classification model. single layer 7x7 convolution with pooling 1x1 convolution shortcut downsample Trained on ImageNet-1k in timm using recipe template described below. Based on ResNet Strikes Back A1 recipe Stronger dropout, stochastic depth, and RandAugment than paper A1 recipe - Deep Residual Learning for Image Recognition: https://arxiv.org/abs/1512.03385 Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 26M parameters timm

Model · Image classification

resnet50.a1_in1k

PyTorch Image Models

A ResNet-B image classification model. single layer 7x7 convolution with pooling 1x1 convolution shortcut downsample Trained on ImageNet-1k in timm using recipe template described below. ResNet Strikes Back A1 recipe - Deep Residual Learning for Image Recognition: https://arxiv.org/abs/1512.03385 Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 26M parameters timm