SAVRN
Search Contact SAVRN

Open-weight model · Audio classification

distil-wav2vec2-adult-child-cls-37m

by Bookbot bookbot/distil-wav2vec2-adult-child-cls-37m

DistilWav2Vec2 Adult/Child Speech Classifier is an audio classification model based on the wav2vec 2.0 architecture. This model is a distilled version of wav2vec2-adult-child-cls on a private adult/child speech classification dataset.

Parameters38M
Context
Weights303.0 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads9.1k

Runs On

What it takes to serve distil-wav2vec2-adult-child-cls-37m (38M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By Bookbot, published under apache-2.0, revision 5410bd526423.

DistilWav2Vec2 Adult/Child Speech Classifier is an audio classification model based on the wav2vec 2.0 architecture. This model is a distilled version of wav2vec2-adult-child-cls on a private adult/child speech classification dataset. This model was trained using HuggingFace's PyTorch framework. All training was done on a Tesla P100, provided by Kaggle. Training metrics were logged via Tensorboard. The model achieves the following results on evaluation: The following hyperparameters were used during training: - learningrate: 3e-05 - trainbatchsize: 32 - evalbatchsize: 32 - seed: 42 - gradientaccumulationsteps: 4 - totaltrainbatchsize: 128 - optimizer: Adam with betas=(0.9,0.999) and…

Read Bookbot's full model card

DistilWav2Vec2 Adult/Child Speech Classifier 37M

DistilWav2Vec2 Adult/Child Speech Classifier is an audio classification model based on the wav2vec 2.0 architecture. This model is a distilled version of wav2vec2-adult-child-cls on a private adult/child speech classification dataset.

This model was trained using HuggingFace's PyTorch framework. All training was done on a Tesla P100, provided by Kaggle. Training metrics were logged via Tensorboard.

Model

Model #params Arch. Training/Validation data (text)
distil-wav2vec2-adult-child-cls-37m 37M wav2vec 2.0 Adult/Child Speech Classification Dataset

Evaluation Results

The model achieves the following results on evaluation:

Dataset Loss Accuracy F1
Adult/Child Speech Classification 0.1431 95.89% 0.9624

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 3e-05
  • train_batch_size: 32
  • eval_batch_size: 32
  • seed: 42
  • gradient_accumulation_steps: 4
  • total_train_batch_size: 128
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_ratio: 0.1
  • num_epochs: 5

Training results

Training Loss Epoch Step Validation Loss Accuracy F1
0.2586 1.0 96 0.2257 0.9298 0.9363
0.1917 2.0 192 0.1743 0.9460 0.9500
0.1568 3.0 288 0.1701 0.9511 0.9545
0.0965 4.0 384 0.1501 0.9548 0.9584
0.1179 5.0 480 0.1431 0.9589 0.9624

Disclaimer

Do consider the biases which came from pre-training datasets that may be carried over into the results of this model.

Authors

DistilWav2Vec2 Adult/Child Speech Classifier was trained and evaluated by Ananto Joyoadikusumo. All computation and development are done on Kaggle.

Framework versions

  • Transformers 4.16.2
  • Pytorch 1.10.2+cu102
  • Datasets 1.18.3
  • Tokenizers 0.10.3

Configuration

Architecture
Wav2Vec2ForSequenceClassification
Layers
4
Hidden size
768
Feed-forward size
3,072
Attention heads
12
Vocabulary size
32
Stored precision
float32
Model type
wav2vec2

Identity and Version

Repository
bookbot/distil-wav2vec2-adult-child-cls-37m
Publisher
Bookbot
Task
Audio classification
Modality
Audio
Library
transformers
Parameters
38M parameters
Languages
en
Revision
5410bd526423b7c95409247274d7be8680b528f7
First published
2022-03-02
Last updated
2024-11-13

Files and Weights

11 files, 303.0 MB in total. The weights are 3 files totalling 303.0 MB in bin, safetensors.

Weights3 files · 303.0 MB
Configuration2 files · 2.7 KB
Documentation1 file · 2.7 KB
Other3 files · 20.1 KB
Repository2 files · 1.2 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights151.5 MB 4e7c49b2aabf
pytorch_model.binWeights151.5 MB 24f50dfdbd9a
training_args.binWeights3.1 KB 4904d7fcf518
config.jsonConfiguration2.5 KB
preprocessor_config.jsonConfiguration215 B
README.mdDocumentation2.7 KB
runs/Feb24_07-24-14_0e74fb71cd15/1645687660.269145/events.out.tfevents.1645687660.0e74fb71cd15.35.1Other4.8 KB 253839b91389
runs/Feb24_07-24-14_0e74fb71cd15/events.out.tfevents.1645687660.0e74fb71cd15.35.0Other14.9 KB ea9fb5192d8b
runs/Feb24_07-24-14_0e74fb71cd15/events.out.tfevents.1645690467.0e74fb71cd15.35.2Other409 B 59c301aff3e0
.gitattributesRepository1.2 KB
.gitignoreRepository13 B

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
303.0 MB
Download from Bookbot

Released by Bookbot through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published303.0 MB
16-bit0.1 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About distil-wav2vec2-adult-child-cls-37m

How much GPU memory does distil-wav2vec2-adult-child-cls-37m need?

About 0.1 GB at 16-bit and 0 GB at 4-bit: the weights (38M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run distil-wav2vec2-adult-child-cls-37m on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use distil-wav2vec2-adult-child-cls-37m commercially?

Yes. distil-wav2vec2-adult-child-cls-37m is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Audio classification

distilhubert-finetuned-gtzan

Rajesh Kumar

This model is a fine-tuned version of ntu-spml/distilhubert on the GTZAN dataset. It achieves the following results on the evaluation set: - evalloss: 0.8970 - evalmodelpreparationtime: 0.0018 - evalaccuracy: 0.87 - evalruntime: 443.4759 - evalsamplespersecond: 0.225 - evalstepspersecond: 0.029 The following hyperparameters were used during training: - learningrate: 5e-05 - trainbatchsize: 8 - evalbatchsize: 8 - lrschedulertype: linear - lrschedulerwarmupsteps: 100 - numepochs: 10 - mixedprecisiontraining: Native AMP - labelsmoothingfactor: 0.1 - Transformers 5.16.1 - Pytorch 2.11.0+cpu - Datasets 2.19.0 - Tokenizers 0.23.1

Open weights apache-2.0 24M parameters transformers

Model · Audio classification

open-vakgyata

OneCXi

open-vakgyata is an open-source language identification model capable of detecting and classifying indian languages from speech inputs. Specification If you use this model in your research or application, please consider citing the model and its base source

Open weights cc-by-nc-4.0 59M parameters transformers

Model · Audio classification

voice-gender-classifier

Huh

This repo contains the inference code to use pretrained human voice gender classifier. - You could also try Huggingface online demo. First, clone the original github repository and install the packages via pip. For those who need pretrained weights, please download it in here State-of-the-art speaker verification model already produces good representation of the speaker's gender. I used the pretrained ECAPA-TDNN from TaoRuijie's repository, added one linear layer to make two-class classifier, and finetuned the model with the VoxCeleb2 dev set. The model achieved 98.7% accuracy on the VoxCeleb1 identification test split. I would like to note the training dataset I've used for this model…

Open weights mit 15M parameters transformers

Model · Audio classification

ced-mini

Speech Team, Xiaomi MiLM Plus

CED are simple ViT-Transformer-based models for audio tagging, achieving sota performance on Audioset. Notable differences from other available models include: 1. Simplification for finetuning: Batchnormalization of Mel-Spectrograms. During finetuning one does not need to first compute mean/variance over the dataset, which is common for AST. 1. Support for variable length inputs. Most other models use a static time-frequency position embedding, which hinders the model's generalization to segments shorter than 10s. Many previous transformers simply pad their input to 10s in order to avoid the performance impact, which in turn slows down training/inference drastically. 1. Training/Inference…

Open weights apache-2.0 10M parameters transformers

Model · Audio classification

WeSpeaker-ResNet34-LM-MLX

Ivan

MLX-compatible weights for WeSpeaker ResNet34-LM, converted from the pyannote speaker embedding model with BatchNorm fused into Conv2d. WeSpeaker ResNet34-LM is a speaker embedding model (~6.6M params) that produces 256-dimensional L2-normalized speaker embeddings from audio. Trained on VoxCeleb for speaker verification and diarization. BatchNorm is fused into Conv2d at conversion time — no BN layers in the MLX model. Part of speech-swift. Converts the original pyannote/wespeaker-voxceleb-resnet34-LM checkpoint using a custom unpickler (no pyannote.audio dependency required). Key transformations: - Fuse BatchNorm into Conv2d: wfused = w × γ/√(σ²+ε), bfused = β − μ×γ/√(σ²+ε) - Transpose…

Open weights mit 7M parameters mlx

Model · Audio classification

Silero-VAD-v6.2.1-MLX

Ivan

MLX port of snakers4/silero-vad tag v6.2.1 for voice activity detection on Apple Silicon. Measured with speech-swift release tests on Apple Silicon using a 20 s 16 kHz speech fixture, 625 streaming chunks. Parity against the matching CoreML v6.2.1 export: The exported safetensors were also checked tensor-by-tensor against the upstream v6.2.1 JIT state dict after conversion; the maximum absolute tensor difference was 0. Converted from snakers4/silero-vad tag v6.2.1. The upstream project is MIT licensed. - speech-swift - Apple SDK - Docs - install and CLI docs - soniqo.audio - website - blog - blog

Open weights mit 309,121 parameters mlx