SAVRN
Search Contact SAVRN

Open-weight model · Image classification

vit_base_patch16_224.augreg_in21k

by PyTorch Image Models timm/vit_base_patch16_224.augreg_in21k

A Vision Transformer (ViT) image classification model. Trained on ImageNet-21k (with additional augmentation and regularization) in JAX by paper authors, ported to PyTorch by Ross Wightman. - How to train your ViT?

Parameters103M
Context
Weights820.8 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads147.2k

Runs On

What it takes to serve vit_base_patch16_224.augreg_in21k (103M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.2 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By PyTorch Image Models, published under apache-2.0, revision bb70896cd6bf.

Model card for vit_base_patch16_224.augreg_in21k

A Vision Transformer (ViT) image classification model. Trained on ImageNet-21k (with additional augmentation and regularization) in JAX by paper authors, ported to PyTorch by Ross Wightman.

Model Details

  • Model Type: Image classification / feature backbone
  • Model Stats:
  • Params (M): 102.6
  • GMACs: 16.9
  • Activations (M): 16.5
  • Image size: 224 x 224
  • Papers:
  • How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers: https://arxiv.org/abs/2106.10270
  • An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale: https://arxiv.org/abs/2010.11929v2
  • Dataset: ImageNet-21k
  • Original: https://github.com/google-research/vision_transformer

Model Usage

Image Classification

from urllib.request import urlopen
from PIL import Image
import timm

img = Image.open(urlopen(
    'https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/beignets-task-guide.png'
))

model = timm.create_model('vit_base_patch16_224.augreg_in21k', pretrained=True)
model = model.eval()

# get model specific transforms (normalization, resize)
data_config = timm.data.resolve_model_data_config(model)
transforms = timm.data.create_transform(**data_config, is_training=False)

output = model(transforms(img).unsqueeze(0))  # unsqueeze single image into batch of 1

top5_probabilities, top5_class_indices = torch.topk(output.softmax(dim=1) * 100, k=5)

Image Embeddings

Read the full model card (362 words)

Identity and Version

Repository
timm/vit_base_patch16_224.augreg_in21k
Publisher
PyTorch Image Models
Task
Image classification
Modality
Image
Library
timm
Parameters
103M parameters
Languages
Not stated by the source
Revision
bb70896cd6bffdd579c3d4f7284f39d0c4ab46c3
First published
2022-12-22
Last updated
2025-01-21

Files and Weights

5 files, 820.8 MB in total. The weights are 2 files totalling 820.8 MB in bin, safetensors.

Weights2 files · 820.8 MB
Configuration1 file · 580 B
Documentation1 file · 3.8 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights410.4 MB 2d31bb5597c7
pytorch_model.binWeights410.4 MB 7521e9c14c49
config.jsonConfiguration580 B
README.mdDocumentation3.8 KB
.gitattributesRepository1.5 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
820.8 MB
Download from PyTorch Image Models

Released by PyTorch Image Models through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published820.8 MB
16-bit0.2 GB
8-bit0.1 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About vit_base_patch16_224.augreg_in21k

How much GPU memory does vit_base_patch16_224.augreg_in21k need?

About 0.2 GB at 16-bit and 0.1 GB at 4-bit: the weights (103M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run vit_base_patch16_224.augreg_in21k on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use vit_base_patch16_224.augreg_in21k commercially?

Yes. vit_base_patch16_224.augreg_in21k is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

A BEiT-v2 image classification model. Trained on ImageNet-1k with self-supervised masked image modelling (MIM) using a VQ-KD encoder as a visual tokenizer (via OpenAI CLIP B/16 teacher). Fine-tuned on ImageNet-22k. - An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale: https://arxiv.org/abs/2010.11929v2 Explore the dataset and runtime metrics of this model in timm model results.

Open weights apache-2.0 103M parameters timm

Model · Image classification

siglip2-x256-explicit-content

Prithiv Sakthi

SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features https://arxiv.org/pdf/2502.14786 The model classifies each image into one of the following content categories: This model is intended for applications such as

Open weights apache-2.0 93M parameters 64 tokens transformers

Model · Image classification

convnextv2-base-22k-384

AI at Meta

ConvNeXt V2 model pretrained using the FCMAE framework and fine-tuned on the ImageNet-22K dataset at resolution 384x384. It was introduced in the paper ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoders by Woo et al. and first released in this repository. Disclaimer: The team releasing ConvNeXT V2 did not write a model card for this model so this model card has been written by the Hugging Face team. ConvNeXt V2 is a pure convolutional model (ConvNet) that introduces a fully convolutional masked autoencoder framework (FCMAE) and a new Global Response Normalization (GRN) layer to ConvNeXt. ConvNeXt V2 significantly improves the performance of pure ConvNets on various…

Open weights apache-2.0 89M parameters transformers

A ConvNeXt-V2 image classification model. Pretrained with a fully convolutional masked autoencoder framework (FCMAE) and fine-tuned on ImageNet-22k and then ImageNet-1k. Explore the dataset and runtime metrics of this model in timm model results. All timing numbers from eager model PyTorch 1.13 on RTX 3090 w/ AMP.

Open weights cc-by-nc-4.0 89M parameters timm

A ConvNeXt image classification model. Pretrained on ImageNet-22k and fine-tuned on ImageNet-1k by paper authors. Explore the dataset and runtime metrics of this model in timm model results. All timing numbers from eager model PyTorch 1.13 on RTX 3090 w/ AMP.

Open weights apache-2.0 89M parameters timm