Open-weight model
wespeaker-voxceleb-resnet34-LM
by Pyannote pyannote/wespeaker-voxceleb-resnet34-LM
Using this open-source model in production? Consider switching to pyannoteAI for better and faster options. This model requires pyannote.audio version 3.1 or higher.
SAVRN's Notes on wespeaker-voxceleb-resnet34-LM
Pyannote packages this one as a wrapper around the WeSpeaker speaker embedding model trained on VoxCeleb, for pyannote.audio 3.1 or newer. The entry lists no memory figures, parameter count or context length, so the number we work from is the weight file: 26.6 MB, PyTorch format, four files. A footprint that small means memory never decides the hardware; what decides it is how many audio streams you embed at once and which GPU the rest of your audio pipeline holds.
CC BY 4.0 allows commercial use provided the creator is credited and changes are indicated, so a deployment needs an attribution line and a record of anything you modify. Access is open, no gate. Two things to check: the dates, released November 13, 2023 and last updated May 10, 2024, and whether the pyannote.audio release you pin still targets this file. It pulls 6.5 million downloads a month.
Model Card
By Pyannote, published under cc-by-4.0, revision 837717ddb9ff.
Using this open-source model in production?
Consider switching to pyannoteAI for better and faster options.
Wrapper around wespeaker-voxceleb-resnet34-LM
This model requires pyannote.audio version 3.1 or higher.
This is a wrapper around WeSpeaker wespeaker-voxceleb-resnet34-LM pretrained speaker embedding model, for use in pyannote.audio.
Basic usage
# instantiate pretrained model
from pyannote.audio import Model
model = Model.from_pretrained("pyannote/wespeaker-voxceleb-resnet34-LM")
from pyannote.audio import Inference
inference = Inference(model, window="whole")
embedding1 = inference("speaker1.wav")
embedding2 = inference("speaker2.wav")
# `embeddingX` is (1 x D) numpy array extracted from the file as a whole.
from scipy.spatial.distance import cdist
distance = cdist(embedding1, embedding2, metric="cosine")[0,0]
# `distance` is a `float` describing how dissimilar speakers 1 and 2 are.
Advanced usage
Running on GPU
import torch
inference.to(torch.device("cuda"))
embedding = inference("audio.wav")
Extract embedding from an excerpt
from pyannote.audio import Inference
from pyannote.core import Segment
inference = Inference(model, window="whole")
excerpt = Segment(13.37, 19.81)
embedding = inference.crop("audio.wav", excerpt)
# `embedding` is (1 x D) numpy array extracted from the file excerpt.
Identity and Version
- Repository
- pyannote/wespeaker-voxceleb-resnet34-LM
- Publisher
- Pyannote
- Task
- Not stated by the source
- Modality
- Other
- Library
- pyannote-audio
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 837717ddb9ff5507820346191109dc79c958d614
- First published
- 2023-11-13
- Last updated
- 2024-05-10
Files and Weights
4 files, 26.7 MB in total. The weights are 1 file totalling 26.6 MB in bin.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| pytorch_model.bin | Weights | 26.6 MB | 366edf44f4c8 |
| config.yaml | Configuration | 221 B | — |
| README.md | Documentation | 3.3 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
License and Download
- License
- cc-by-4.0
- Access
- Open weights, no gate
- Download size
- 26.6 MB
Released by Pyannote through its official repository on Hugging Face. Read the license.
Built From
- Trained on (disclosed) voxceleb
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 26.6 MB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Built on This Model
- Derived fromWeSpeaker-ResNet34-LM-MLX
Questions About wespeaker-voxceleb-resnet34-LM
Can I use wespeaker-voxceleb-resnet34-LM commercially?
Yes. wespeaker-voxceleb-resnet34-LM is released under Creative Commons Attribution 4.0. CC BY 4.0 permits sharing and adapting the work, including commercially, provided the creator is credited and changes are indicated.