SAVRN
Search Contact SAVRN

Open-weight model · Video classification

videomae-base-finetuned-ssv2

by Multimedia Computing Group-Nanjing University MCG-NJU/videomae-base-finetuned-ssv2

VideoMAE model pre-trained for 2400 epochs in a self-supervised way and fine-tuned in a supervised way on Something-Something-v2.

Parameters
Context
Weights345.5 MB
Licensecc-by-nc-4.0
AccessOpen weights
Monthly Downloads3.4k

Model Card

VideoMAE model pre-trained for 2400 epochs in a self-supervised way and fine-tuned in a supervised way on Something-Something-v2. It was introduced in the paper VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training by Tong et al. and first released in this repository. Disclaimer: The team releasing VideoMAE did not write a model card for this model so this model card has been written by the Hugging Face team. VideoMAE is an extension of Masked Autoencoders (MAE) to video. The architecture of the model is very similar to that of a standard Vision Transformer (ViT), with a decoder on top for predicting pixel values for masked patches. Videos are…

Excerpt from the card by Multimedia Computing Group-Nanjing University, licensed cc-by-nc-4.0.

Configuration

Architecture
VideoMAEForVideoClassification
Layers
12
Hidden size
768
Feed-forward size
3,072
Attention heads
12
Stored precision
float32
Model type
videomae

Identity and Version

Repository
MCG-NJU/videomae-base-finetuned-ssv2
Publisher
Multimedia Computing Group-Nanjing University
Task
Video classification
Modality
Video
Library
transformers
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
e3f23b7a9bcc6f6b0bbf44da097c0f94548c6ec5
First published
2022-08-02
Last updated
2023-04-22

Files and Weights

5 files, 345.5 MB in total. The weights are 1 file totalling 345.5 MB in bin.

Weights1 file · 345.5 MB
Configuration2 files · 21.6 KB
Documentation1 file · 3.6 KB
Repository1 file · 1.3 KB
Every file
FileTypeSizeSHA-256
pytorch_model.binWeights345.5 MB b960dafd7b30
config.jsonConfiguration21.3 KB
preprocessor_config.jsonConfiguration271 B
README.mdDocumentation3.6 KB
.gitattributesRepository1.3 KB

License and Download

License
cc-by-nc-4.0
Access
Open weights, no gate
Download size
345.5 MB
Download from Multimedia Computing Group-Nanjing University

Released by Multimedia Computing Group-Nanjing University through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published345.5 MB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About videomae-base-finetuned-ssv2

Can I use videomae-base-finetuned-ssv2 commercially?

Not without separate permission. videomae-base-finetuned-ssv2 is released under Creative Commons Attribution-NonCommercial 4.0. CC BY-NC 4.0 permits sharing and adapting with credit for non-commercial purposes only. Commercial use needs separate permission from the rights holder.

Similar Models

Model · Video classification

vivit-b-16x2-kinetics400

Google

ViViT model as introduced in the paper ViViT: A Video Vision Transformer by Arnab et al. and first released in this repository. Disclaimer: The team releasing ViViT did not write a model card for this model so this model card has been written by the Hugging Face team. ViViT is an extension of the Vision Transformer (ViT) to video. We refer to the paper for details. The model is mostly meant to intended to be fine-tuned on a downstream task, like video classification. See the model hub to look for fine-tuned versions on a task that interests you. For code examples, we refer to the documentation.

Open weights mit transformers

Model · Video classification

vivit-b-16x2

Google

ViViT model as introduced in the paper ViViT: A Video Vision Transformer by Arnab et al. and first released in this repository. Disclaimer: The team releasing ViViT did not write a model card for this model so this model card has been written by the Hugging Face team. ViViT is an extension of the Vision Transformer (ViT) to video. We refer to the paper for details. The model is mostly meant to intended to be fine-tuned on a downstream task, like video classification. See the model hub to look for fine-tuned versions on a task that interests you. For code examples, we refer to the documentation.

Open weights mit transformers

Model · Video classification

timesformer-base-finetuned-k600

AI at Meta

TimeSformer model pre-trained on Kinetics-600. It was introduced in the paper TimeSformer: Is Space-Time Attention All You Need for Video Understanding? by Tong et al. and first released in this repository. Disclaimer: The team releasing TimeSformer did not write a model card for this model so this model card has been written by fcakyon. You can use the raw model for video classification into one of the 600 possible Kinetics-600 labels. Here is how to use this model to classify a video: For more code examples, we refer to the documentation.

Open weights cc-by-nc-4.0 transformers

Model · Video classification

timesformer-base-finetuned-k400

AI at Meta

TimeSformer model pre-trained on Kinetics-400. It was introduced in the paper TimeSformer: Is Space-Time Attention All You Need for Video Understanding? by Tong et al. and first released in this repository. Disclaimer: The team releasing TimeSformer did not write a model card for this model so this model card has been written by fcakyon. You can use the raw model for video classification into one of the 400 possible Kinetics-400 labels. Here is how to use this model to classify a video: For more code examples, we refer to the documentation.

Open weights cc-by-nc-4.0 transformers

Model · Video classification

xclip-large-patch14-16-frames

Microsoft

X-CLIP model (large-sized, patch resolution of 14) trained fully-supervised on Kinetics-400. It was introduced in the paper Expanding Language-Image Pretrained Models for General Video Recognition by Ni et al. and first released in this repository. This model was trained using 16 frames per video, at a resolution of 336x336. Disclaimer: The team releasing X-CLIP did not write a model card for this model so this model card has been written by the Hugging Face team. X-CLIP is a minimal extension of CLIP for general video-language understanding. The model is trained in a contrastive way on (video, text) pairs. This allows the model to be used for tasks like zero-shot, few-shot or fully…

Open weights mit 77 tokens transformers

Model · Video classification

VJEPA2-ViTL-SSv2-CoreAI

Daisuke Majima (MLBoy)

Core AI is Apple's on-device ML runtime in iOS 27 / macOS 27 and the successor to Core ML: PyTorch models are exported with Apple's coreai-torch (LLMs: coreai.llm.export) into.aimodel bundles that run on the GPU or the Neural Engine, e.g. Qwen3-8B 4-bit decodes at 94 tok/s on an M4 Max GPU, MLX 90 under the same protocol (apple-silicon-llm-bench, macOS 27 beta 26A5353q, 2026-06-11). This model has no row on DeviceMark, the on-device LLM leaderboard. V-JEPA 2 (Meta AI) running natively on the Apple Core AI engine — the zoo's first world model: a self-supervised video encoder that learns by predicting in representation space (JEPA), here with the Something-Something v2 action head (174…

Open weights mit coreai