SAVRN
Search Contact SAVRN

Open-weight model

wespeaker-voxceleb-resnet34-LM

by Pyannote pyannote/wespeaker-voxceleb-resnet34-LM

Using this open-source model in production? Consider switching to pyannoteAI for better and faster options. This model requires pyannote.audio version 3.1 or higher.

Parameters
Context
Weights26.6 MB
Licensecc-by-4.0
AccessOpen weights
Monthly Downloads6.5M

SAVRN's Notes on wespeaker-voxceleb-resnet34-LM

Pyannote packages this one as a wrapper around the WeSpeaker speaker embedding model trained on VoxCeleb, for pyannote.audio 3.1 or newer. The entry lists no memory figures, parameter count or context length, so the number we work from is the weight file: 26.6 MB, PyTorch format, four files. A footprint that small means memory never decides the hardware; what decides it is how many audio streams you embed at once and which GPU the rest of your audio pipeline holds.

CC BY 4.0 allows commercial use provided the creator is credited and changes are indicated, so a deployment needs an attribution line and a record of anything you modify. Access is open, no gate. Two things to check: the dates, released November 13, 2023 and last updated May 10, 2024, and whether the pyannote.audio release you pin still targets this file. It pulls 6.5 million downloads a month.

Model Card

By Pyannote, published under cc-by-4.0, revision 837717ddb9ff.

Using this open-source model in production?
Consider switching to pyannoteAI for better and faster options.

Wrapper around wespeaker-voxceleb-resnet34-LM

This model requires pyannote.audio version 3.1 or higher.

This is a wrapper around WeSpeaker wespeaker-voxceleb-resnet34-LM pretrained speaker embedding model, for use in pyannote.audio.

Basic usage

# instantiate pretrained model
from pyannote.audio import Model
model = Model.from_pretrained("pyannote/wespeaker-voxceleb-resnet34-LM")
from pyannote.audio import Inference
inference = Inference(model, window="whole")
embedding1 = inference("speaker1.wav")
embedding2 = inference("speaker2.wav")
# `embeddingX` is (1 x D) numpy array extracted from the file as a whole.

from scipy.spatial.distance import cdist
distance = cdist(embedding1, embedding2, metric="cosine")[0,0]
# `distance` is a `float` describing how dissimilar speakers 1 and 2 are.

Advanced usage

Running on GPU

import torch
inference.to(torch.device("cuda"))
embedding = inference("audio.wav")

Extract embedding from an excerpt

from pyannote.audio import Inference
from pyannote.core import Segment
inference = Inference(model, window="whole")
excerpt = Segment(13.37, 19.81)
embedding = inference.crop("audio.wav", excerpt)
# `embedding` is (1 x D) numpy array extracted from the file excerpt.

Read the full model card (320 words)

Identity and Version

Repository
pyannote/wespeaker-voxceleb-resnet34-LM
Publisher
Pyannote
Task
Not stated by the source
Modality
Other
Library
pyannote-audio
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
837717ddb9ff5507820346191109dc79c958d614
First published
2023-11-13
Last updated
2024-05-10

Files and Weights

4 files, 26.7 MB in total. The weights are 1 file totalling 26.6 MB in bin.

Weights1 file · 26.6 MB
Configuration1 file · 221 B
Documentation1 file · 3.3 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
pytorch_model.binWeights26.6 MB 366edf44f4c8
config.yamlConfiguration221 B
README.mdDocumentation3.3 KB
.gitattributesRepository1.5 KB

License and Download

License
cc-by-4.0
Access
Open weights, no gate
Download size
26.6 MB
Download from Pyannote

Released by Pyannote through its official repository on Hugging Face. Read the license.

Built From

  • Trained on (disclosed) voxceleb

Memory Requirements

PrecisionWeights in memory
As published26.6 MB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Questions About wespeaker-voxceleb-resnet34-LM

Can I use wespeaker-voxceleb-resnet34-LM commercially?

Yes. wespeaker-voxceleb-resnet34-LM is released under Creative Commons Attribution 4.0. CC BY 4.0 permits sharing and adapting the work, including commercially, provided the creator is credited and changes are indicated.