# Parameter-Free Attentive Scoring for Speaker Verification
Source: https://savrn.com/papers/parameter-free-attentive-scoring-for-speaker-verification
Markdown alternate of the page above; the site index is https://savrn.com/llms.txt

---

## Abstract

This paper presents a novel study of parameter-free attentive scoring for speaker verification. Parameter-free scoring provides the flexibility of comparing speaker representations without the need of an accompanying parametric scoring model. Inspired by the attention component in Transformer neural networks, we propose a variant of the scaled dot product attention mechanism to compare enrollment and test segment representations. In addition, this work explores the effect on performance of (i) different types of normalization, (ii) independent versus tied query/key estimation, (iii) varying the number of key-value pairs and (iv) pooling multiple enrollment utterance statistics. Experimental results for a 4 task average show that a simple parameter-free attentive scoring mechanism can improve the average EER by 10% over the best cosine similarity baseline.

[Full paper on arXiv](https://arxiv.org/abs/2203.05642)

## Details

arXiv identifier

2203.05642

Published

2022-03-10

Authors

Jason Pelecanos, Quan Wang, Yiling Huang, Ignacio Lopez Moreno

## Open Models Built on This Paper

Every model in the SAVRN Model Hub whose card cites this paper, most downloaded first, with what it takes to run each one.

| Model | Task | Size | License | Monthly downloads | Cheapest setup at 16-bit |
| --- | --- | --- | --- | --- | --- |
| [univ_conformer_small_ge2e](https://savrn.com/models/univ-conformer-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 31 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_lstm_small_ge2e](https://savrn.com/models/univ-lstm-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 29 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_ecapa_tdnn_small_ge2e](https://savrn.com/models/univ-ecapa-tdnn-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 25 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_lstm_small_ge2e](https://savrn.com/models/ls-lstm-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 25 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_conformer_small_ge2e](https://savrn.com/models/ls-conformer-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 23 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_ecapa_tdnn_small_ge2e](https://savrn.com/models/ls-ecapa-tdnn-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 22 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_tiny_ge2e](https://savrn.com/models/univ-conformer-tiny-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 693,124 | apache-2.0 | 14 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_small_dr_vectors](https://savrn.com/models/univ-conformer-small-dr-vectors) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 13 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_small_arcface](https://savrn.com/models/univ-conformer-small-arcface) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 13 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [cn_conformer_small_pfas](https://savrn.com/models/cn-conformer-small-pfas) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 13 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [vox_ecapa_tdnn_small_ext_softmax](https://savrn.com/models/vox-ecapa-tdnn-small-ext-softmax) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_transformer_small_ge2e](https://savrn.com/models/univ-transformer-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 1M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_mamba_small_ge2e](https://savrn.com/models/univ-mamba-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 1M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_ecapa_tdnn_tiny_ge2e](https://savrn.com/models/univ-ecapa-tdnn-tiny-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 626,720 | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_ecapa_tdnn_base_ge2e](https://savrn.com/models/univ-ecapa-tdnn-base-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 3M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_small_pfas_ge2e](https://savrn.com/models/univ-conformer-small-pfas-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_small_ext_softmax](https://savrn.com/models/univ-conformer-small-ext-softmax) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_small_pfas](https://savrn.com/models/univ-conformer-small-pfas) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_resnet_small_ge2e](https://savrn.com/models/ls-resnet-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_transformer_small_ge2e](https://savrn.com/models/ls-transformer-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 1M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_conformer_small_pfas_ge2e](https://savrn.com/models/ls-conformer-small-pfas-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [cn_conformer_small_ge2e](https://savrn.com/models/cn-conformer-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_conformer_small_arcface](https://savrn.com/models/ls-conformer-small-arcface) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 12 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_resnet_small_ge2e](https://savrn.com/models/univ-resnet-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_small_triplet](https://savrn.com/models/univ-conformer-small-triplet) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_small_sphereface](https://savrn.com/models/univ-conformer-small-sphereface) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_small_cosface](https://savrn.com/models/univ-conformer-small-cosface) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_ecapa_tdnn_tiny_ge2e](https://savrn.com/models/ls-ecapa-tdnn-tiny-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 626,720 | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_mamba_small_ge2e](https://savrn.com/models/ls-mamba-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 1M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_conformer_small_sphereface](https://savrn.com/models/ls-conformer-small-sphereface) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_conformer_tiny_ge2e](https://savrn.com/models/ls-conformer-tiny-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 693,124 | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [cn_conformer_small_dr_vectors](https://savrn.com/models/cn-conformer-small-dr-vectors) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [cn_ecapa_tdnn_small_arcface](https://savrn.com/models/cn-ecapa-tdnn-small-arcface) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_conformer_small_cosface](https://savrn.com/models/ls-conformer-small-cosface) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_conformer_small_dr_vectors](https://savrn.com/models/ls-conformer-small-dr-vectors) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 11 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [univ_conformer_base_ge2e](https://savrn.com/models/univ-conformer-base-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 5M | apache-2.0 | 10 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_ecapa_tdnn_base_ge2e](https://savrn.com/models/ls-ecapa-tdnn-base-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 3M | apache-2.0 | 10 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_conformer_small_pfas](https://savrn.com/models/ls-conformer-small-pfas) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 10 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [ls_conformer_small_triplet](https://savrn.com/models/ls-conformer-small-triplet) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 10 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |
| [vox_conformer_small_ge2e](https://savrn.com/models/vox-conformer-small-ge2e) Quan | [Audio classification](https://savrn.com/models/tasks/audio-classification) | 2M | apache-2.0 | 9 | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) $1.85/hr |

## Explore More

- [All research papers](https://savrn.com/papers)
- [The model directory](https://savrn.com/models)
- [Datasets](https://savrn.com/datasets)

## Source

- arXiv metadata, read 2026-10-18.
- [How the hub is built](https://savrn.com/model-hub/methodology)