SAVRN
Search Contact SAVRN

Open-weight model · Image classification

vit_tiny_patch16_224.augreg_in21k_ft_in1k

by PyTorch Image Models timm/vit_tiny_patch16_224.augreg_in21k_ft_in1k

A Vision Transformer (ViT) image classification model. Trained on ImageNet-21k and fine-tuned on ImageNet-1k (with additional augmentation and regularization) in JAX by paper authors, ported to PyTorch by Ross Wightman. - How to train your ViT?

Parameters6M
Context
Weights45.8 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads190.3k

Runs On

What it takes to serve vit_tiny_patch16_224.augreg_in21k_ft_in1k (6M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By PyTorch Image Models, published under apache-2.0, revision 7d3afdd0cf93.

Model card for vit_tiny_patch16_224.augreg_in21k_ft_in1k

A Vision Transformer (ViT) image classification model. Trained on ImageNet-21k and fine-tuned on ImageNet-1k (with additional augmentation and regularization) in JAX by paper authors, ported to PyTorch by Ross Wightman.

Model Details

  • Model Type: Image classification / feature backbone
  • Model Stats:
  • Params (M): 5.7
  • GMACs: 1.1
  • Activations (M): 4.1
  • Image size: 224 x 224
  • Papers:
  • How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers: https://arxiv.org/abs/2106.10270
  • An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale: https://arxiv.org/abs/2010.11929v2
  • Dataset: ImageNet-1k
  • Pretrain Dataset: ImageNet-21k
  • Original: https://github.com/google-research/vision_transformer

Model Usage

Image Classification

from urllib.request import urlopen
from PIL import Image
import timm

img = Image.open(urlopen(
    'https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/beignets-task-guide.png'
))

model = timm.create_model('vit_tiny_patch16_224.augreg_in21k_ft_in1k', pretrained=True)
model = model.eval()

# get model specific transforms (normalization, resize)
data_config = timm.data.resolve_model_data_config(model)
transforms = timm.data.create_transform(**data_config, is_training=False)

output = model(transforms(img).unsqueeze(0))  # unsqueeze single image into batch of 1

top5_probabilities, top5_class_indices = torch.topk(output.softmax(dim=1) * 100, k=5)

Image Embeddings

Read the full model card (369 words)

Identity and Version

Repository
timm/vit_tiny_patch16_224.augreg_in21k_ft_in1k
Publisher
PyTorch Image Models
Task
Image classification
Modality
Image
Library
timm
Parameters
6M parameters
Languages
Not stated by the source
Revision
7d3afdd0cf93ad84d986eb2d6bcc5812ebd0b106
First published
2022-12-22
Last updated
2025-01-21

Files and Weights

5 files, 45.8 MB in total. The weights are 2 files totalling 45.8 MB in bin, safetensors.

Weights2 files · 45.8 MB
Configuration1 file · 586 B
Documentation1 file · 3.9 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights22.9 MB fecf81b492bd
pytorch_model.binWeights22.9 MB 765ebd32b9f2
config.jsonConfiguration586 B
README.mdDocumentation3.9 KB
.gitattributesRepository1.5 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
45.8 MB
Download from PyTorch Image Models

Released by PyTorch Image Models through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published45.8 MB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Compare vit_tiny_patch16_224.augreg_in21k_ft_in1k

Questions About vit_tiny_patch16_224.augreg_in21k_ft_in1k

How much GPU memory does vit_tiny_patch16_224.augreg_in21k_ft_in1k need?

About 0 GB at 16-bit and 0 GB at 4-bit: the weights (6M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run vit_tiny_patch16_224.augreg_in21k_ft_in1k on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use vit_tiny_patch16_224.augreg_in21k_ft_in1k commercially?

Yes. vit_tiny_patch16_224.augreg_in21k_ft_in1k is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Image classification

deit_tiny_patch16_224.fb_in1k

PyTorch Image Models

A DeiT image classification model. Trained on ImageNet-1k by paper authors. - Training data-efficient image transformers & distillation through attention: https://arxiv.org/abs/2012.12877 Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 6M parameters timm

Model · Image classification

efficientnet_b0.ra_in1k

PyTorch Image Models

A EfficientNet image classification model. Trained on ImageNet-1k in timm using recipe template described below. RandAugment RA recipe. Inspired by and evolved from EfficientNet RandAugment recipes. Published as B recipe in ResNet Strikes Back. RMSProp (TF 1.0 behaviour) optimizer, EMA weight averaging Step (exponential decay w/ staircase) LR schedule with warmup Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 5M parameters timm

A MobileNet-v3 image classification model. Trained on ImageNet-1k in Tensorflow by paper authors, ported to PyTorch by Ross Wightman. Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 4M parameters timm

A MobileNet-V4 image classification model. Trained on ImageNet-1k by Ross Wightman. Trained with timm scripts using hyper-parameters inspired by the MobileNet-V4 paper with timm enhancements. NOTE: So far, these are the only known MNV4 weights. Official weights for Tensorflow models are unreleased. - MobileNetV4 -- Universal Models for the Mobile Ecosystem: https://arxiv.org/abs/2404.10518

Open weights apache-2.0 4M parameters timm

Model · Image classification

densenet121.ra_in1k

PyTorch Image Models

A DenseNet image classification model. Pretrained on ImageNet-1k in timm by Ross Wightman using RandAugment RA recipe. Related to B recipe in ResNet Strikes Back.

Open weights apache-2.0 8M parameters timm