SAVRN
Search Contact SAVRN

Open-weight model · Audio classification

Deepfake-audio-detection

by Mohammed Abdeldayem mo-thecreator/Deepfake-audio-detection

This model is a fine-tuned version of mo-thecreator/wav2vec2-base-finetuned on the None dataset.

Parameters95M
Context
Weights378.3 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads12.5k

Runs On

What it takes to serve Deepfake-audio-detection (95M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.2 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By Mohammed Abdeldayem, published under apache-2.0, revision e4d9874b4933.

This model is a fine-tuned version of mo-thecreator/wav2vec2-base-finetuned on the None dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 3e-05 - trainbatchsize: 8 - evalbatchsize: 8 - gradientaccumulationsteps: 4 - totaltrainbatchsize: 32 - lrschedulertype: linear - lrschedulerwarmupratio: 0.1 - numepochs: 5 - Transformers 4.39.3 - Pytorch 2.1.2 - Datasets 2.18.0 - Tokenizers 0.15.2 - mo-thecreator

Read Mohammed Abdeldayem's full model card

wav2vec2-base-finetuned-finetuned

This model is a fine-tuned version of mo-thecreator/wav2vec2-base-finetuned on the None dataset. It achieves the following results on the evaluation set: - Loss: 0.0829 - Accuracy: 0.9882

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training: - learning_rate: 3e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - gradient_accumulation_steps: 4 - total_train_batch_size: 32 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - lr_scheduler_warmup_ratio: 0.1 - num_epochs: 5

Training results

Training Loss Epoch Step Accuracy Validation Loss
0.1448 1.0 1900 0.9601 0.1447
0.0673 2.0 3800 0.9824 0.0817
0.0178 3.0 5700 0.9796 0.1054
0.0002 4.0 7600 0.9824 0.1074
0.0108 5.0 9500 0.9882 0.0829

Framework versions

  • Transformers 4.39.3
  • Pytorch 2.1.2
  • Datasets 2.18.0
  • Tokenizers 0.15.2

Contributors

  • Abdalla312
  • mo-thecreator

Configuration

Architecture
Wav2Vec2ForSequenceClassification
Layers
12
Hidden size
768
Feed-forward size
3,072
Attention heads
12
Vocabulary size
32
Stored precision
float32
Model type
wav2vec2

Identity and Version

Repository
mo-thecreator/Deepfake-audio-detection
Publisher
Mohammed Abdeldayem
Task
Audio classification
Modality
Audio
Library
transformers
Parameters
95M parameters
Languages
Not stated by the source
Revision
e4d9874b493362149cec96ced85f00b00b1a04c0
First published
2024-05-18
Last updated
2025-04-23

Files and Weights

11 files, 378.6 MB in total. The weights are 2 files totalling 378.3 MB in bin, safetensors.

Weights2 files · 378.3 MB
Configuration2 files · 2.7 KB
Documentation1 file · 1.8 KB
Other5 files · 269.6 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights378.3 MB 6eaf9d5638b6
training_args.binWeights5.0 KB 6b3129923f6d
config.jsonConfiguration2.5 KB
preprocessor_config.jsonConfiguration215 B
README.mdDocumentation1.8 KB
runs/May18_00-36-33_8fdb05dffce8/events.out.tfevents.1715992606.8fdb05dffce8.34.0Other6.5 KB 070990f8b93a
runs/May18_00-40-51_8fdb05dffce8/events.out.tfevents.1715992857.8fdb05dffce8.34.1Other6.5 KB 89c65b4e33aa
runs/May18_00-41-14_8fdb05dffce8/events.out.tfevents.1715992882.8fdb05dffce8.34.2Other87.3 KB 7f63938688a7
runs/May18_12-31-00_276a264a9557/events.out.tfevents.1716035629.276a264a9557.34.0Other168.5 KB 119ea5f85e02
runs/May18_12-31-00_276a264a9557/events.out.tfevents.1716052647.276a264a9557.34.1Other734 B 0538b57d3580
.gitattributesRepository1.5 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
378.3 MB
Download from Mohammed Abdeldayem

Released by Mohammed Abdeldayem through its official repository on Hugging Face. Read the license.

Built From

  • Derived from mo-thecreator/wav2vec2-base-finetuned

Memory Requirements

PrecisionWeights in memory
As published378.3 MB
16-bit0.2 GB
8-bit0.1 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Questions About Deepfake-audio-detection

How much GPU memory does Deepfake-audio-detection need?

About 0.2 GB at 16-bit and 0.1 GB at 4-bit: the weights (95M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Deepfake-audio-detection on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use Deepfake-audio-detection commercially?

Yes. Deepfake-audio-detection is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Audio classification

Common-Voice-Gender-Detection

Prithiv Sakthi

Wav2Vec2: Self-Supervised Learning for Speech Recognition: https://arxiv.org/pdf/2006.11477 male female Common-Voice-Gender-Detection is designed for: Speech Analytics – Assist in analyzing speaker demographics in call centers or customer service recordings. Conversational AI Personalization – Adjust tone or dialogue based on gender detection for more personalized voice assistants. Voice Dataset Curation – Automatically tag or filter voice datasets by speaker gender for better dataset management. Research Applications – Enable linguistic and acoustic research involving gender-specific speech patterns. Multimedia Content Tagging – Automate metadata generation for gender identification in…

Open weights apache-2.0 95M parameters transformers

Model · Audio classification

Deepfake-audio-detection-V2

Melody Machine

This model is a fine-tuned version of motheecreator/Deepfake-audio-detection on the audiofolder dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 3e-05 - trainbatchsize: 32 - evalbatchsize: 32 - gradientaccumulationsteps: 4 - totaltrainbatchsize: 128 - lrschedulertype: cosine - lrschedulerwarmupratio: 0.1 - numepochs: 5 - Transformers 4.41.2 - Pytorch 2.1.2 - Datasets 2.19.2 - Tokenizers 0.19.1

Open weights apache-2.0 95M parameters transformers

Model · Audio classification

wav2vec2-emotion-recognition

Deepan Gautam

This model is a fine-tuned version of facebook/wav2vec2-base-960h for Speech Emotion Recognition (SER). It has been trained using a Frozen Feature Extractor strategy to preserve the model's acoustic understanding while adapting to emotion detection. This approach ensures stable performance and prevents "Catastrophic Forgetting," achieving nearly 80% accuracy on the validation set. Update: The "Calm" and "Neutral" classes have been merged to improve classification consistency, resulting in 7 distinct emotion classes. The model was trained on a combined dataset of ~12,000 audio files from: The model classifies audio into one of the following emotions: 1. Angry 2. Disgust 3. Fear 4. Happy 5.…

Open weights mit 95M parameters transformers

Model · Audio classification

wav2vec2-base-drum-kit

Andrew Keig

Fine-tuned facebook/wav2vec2-base for audio classification of single drum/percussion sounds into 10 classes. - clap, conga, crash, cymbal, hat, kick, ride, rim, snare, tom - Trained on short, single-hit drum sounds. Performance may drop on long mixes, multiple overlapping sounds, or very different recording conditions.

Open weights mit 95M parameters

The model expects a raw audio signal as input and outputs predictions for age in a range of approximately 0...1 (0...100 years) and gender expressing the probababilty for being child, female, or male. In addition, it also provides the pooled states of the last transformer layer. The model was created by fine-tuning Wav2Vec2-Large-Robust Timit and For this version of the model we only trained the first six transformer layers. An ONNX export of the model is available from Further details are given in the associated paper and tutorial.

Open weights cc-by-nc-sa-4.0 91M parameters transformers

Audio Spectrogram Transformer (AST) model fine-tuned on AudioSet. It was introduced in the paper AST: Audio Spectrogram Transformer by Gong et al. and first released in this repository. Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Audio Spectrogram Transformer is equivalent to ViT, but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks. You can use the raw model for classifying audio into one of the AudioSet classes. See…

Open weights bsd-3-clause 87M parameters transformers