SAVRN
Search Contact SAVRN

Open-weight model · Speech recognition

koelsch-wav2vec2-ipa

by Chem Vatho/koelsch-wav2vec2-ipa

IPA phoneme recognition for Kölsch (Ripuarian German, Cologne). Fine-tuned from facebook/wav2vec2-xls-r-300m with a CTC head over a 48-symbol IPA inventory. This is also the forced-alignment model.

Parameters315M
Context
Weights1.3 GB
Licensecc-by-nc-sa-4.0
AccessOpen weights
Monthly Downloads31

Runs On

What it takes to serve koelsch-wav2vec2-ipa (315M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.6 GB 0.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.3 GB 0.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.2 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

IPA phoneme recognition for Kölsch (Ripuarian German, Cologne). Fine-tuned from facebook/wav2vec2-xls-r-300m with a CTC head over a 48-symbol IPA inventory. This is also the forced-alignment model. Its frame-level CTC posteriors drive torchaudio.functional.forcedalign to produce Praat TextGrids with word and phone tiers — see notebook 9 in the repository. Trained during the CIF Tandem Fellowship at IfL-Phonetik, University of Cologne, on Alles Kölsch (Bhatt & Lindlar 1998) — 4,670 utterances, 4.5 hours of spontaneous Cologne dialect speech from 105 speakers aged 10–88 across 49 neighbourhoods. Kölsch is Ripuarian German. It has no public speech dataset and no standardised spelling: 94.1 %…

Excerpt from the card by Chem, licensed cc-by-nc-sa-4.0.

Configuration

Architecture
Wav2Vec2ForCTC
Layers
24
Hidden size
1,024
Feed-forward size
4,096
Attention heads
16
Vocabulary size
53
Model type
wav2vec2

Identity and Version

Repository
Vatho/koelsch-wav2vec2-ipa
Publisher
Chem
Task
Speech recognition
Modality
Audio
Library
transformers
Parameters
315M parameters
Languages
ksh, de
Revision
01f93093b7acfc59df6cb64422dbf80da7541bb6
First published
2026-09-05
Last updated
2026-09-18

Files and Weights

10 files, 1.3 GB in total. The weights are 2 files totalling 1.3 GB in bin, safetensors.

Weights2 files · 1.3 GB
Configuration4 files · 2.6 KB
Tokenizer2 files · 1.7 KB
Documentation1 file · 4.6 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.3 GB 24071e290ffa
training_args.binWeights5.2 KB 6bc3bef3e76c
added_tokens.jsonConfiguration30 B
config.jsonConfiguration2.1 KB
preprocessor_config.jsonConfiguration214 B
processor_config.jsonConfiguration299 B
README.mdDocumentation4.6 KB
.gitattributesRepository1.5 KB
tokenizer_config.jsonTokenizer1.1 KB
vocab.jsonTokenizer617 B

License and Download

License
cc-by-nc-sa-4.0
Access
Open weights, no gate
Download size
1.3 GB
Download from Chem

Released by Chem through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published1.3 GB
16-bit0.6 GB
8-bit0.3 GB
4-bit0.2 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About koelsch-wav2vec2-ipa

How much GPU memory does koelsch-wav2vec2-ipa need?

About 0.8 GB at 16-bit and 0.2 GB at 4-bit: the weights (315M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run koelsch-wav2vec2-ipa on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use koelsch-wav2vec2-ipa commercially?

Not without separate permission. koelsch-wav2vec2-ipa is released under Creative Commons Attribution-NonCommercial-ShareAlike 4.0. CC BY-NC-SA 4.0 permits non-commercial sharing and adapting with credit, and requires adaptations to use the same license. Commercial use needs separate permission.

Similar Models

This model for Croatian ASR is based on the facebook/wav2vec2-xls-r-300m model and was fine-tuned with 300 hours of recordings and transcripts from the ASR Croatian parliament dataset ParlaSpeech-HR v1.0. If you use this model, please cite the following paper: Nikola Ljubešić, Danijel Koržinek, Peter Rupnik, Ivo-Pavao Jazbec. ParlaSpeech-HR -- a freely available ASR dataset for Croatian bootstrapped from the ParlaMint corpus. http://www.lrec-conf.org/proceedings/lrec2022/workshops/ParlaCLARINIII/pdf/2022.parlaclariniii-1.16.pdf Evaluation is performed on the dev and test portions of the ParlaSpeech-HR v1.0 dataset. There are multiple models available, and in terms of CER and WER, the…

Open weights 315M parameters transformers

Model · Speech recognition

wav2vec2-large-xls-r-300m-Urdu

Abid Ali Awan

A fine-tuned XLS-R 300M CTC model for Urdu automatic speech recognition. It transcribes 16 kHz mono audio and includes an optional 5-gram KenLM decoder. Best reported result: 39.89% WER / 16.70% CER with KenLM decoding on the Urdu Common Voice 8.0 test set. See the Kaggle evaluation notebook for a reproducible example. The repository contains a 5-gram KenLM language model. The Kaggle notebook evaluates a five-sample streaming smoke test from fixie-ai/commonvoice170 (ur, test). Results are reported on the Urdu test split of Mozilla Common Voice 8.0. The language-model row is the model-card score; compare each result only with the same decoding strategy. To reproduce language-model evaluation…

Open weights apache-2.0 315M parameters transformers

Model · Speech recognition

wav2vec2-large-xlsr-mvc-swahili

Eddie Gulay

This model is a finetuned version of facebook/wav2vec2-large-xlsr-53. There was an issue with vocab, seems like there are special characters included and they were not considered during training You could try

Open weights apache-2.0 315M parameters transformers

Finetuned version of KBs VoxRex large model using Swedish radio broadcasts, NST and Common Voice data. Evalutation without a language model gives the following: WER for NST + Common Voice test set (2% of total sentences) is 2.5%. WER for Common Voice test set is 8.49% directly and 7.37% with a 4-gram language model. When using this model, make sure that your speech input is sampled at 16kHz. This model has been fine-tuned for 120000 updates on NST + CommonVoice and then for an additional 20000 updates on CommonVoice only. The additional fine-tuning on CommonVoice hurts performance on the NST+CommonVoice test set somewhat and, unsurprisingly, improves it on the CommonVoice test set. It seems…

Open weights cc0-1.0 315M parameters transformers

Model · Speech recognition

wav2vec2-xls-r-300m-cs-250

Vojtěch Drábek

This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the commonvoice 8.0 dataset as well as other datasets listed below. It achieves the following results on the evaluation set: The eval.py script results using a LM are: Fine-tuned facebook/wav2vec2-large-xlsr-53 on Czech using the Common Voice dataset. When using this model, make sure that your speech input is sampled at 16kHz. The model can be used directly (without a language model) as follows: The model can be evaluated using the attached eval.py script: The Common Voice 8.0 train and validation datasets were used for training, as well as the following datasets: - Šmídl, Luboš and Pražák, Aleš, 2013, OVM – Otázky…

Open weights apache-2.0 315M parameters transformers

Model · Speech recognition

Wav2Vec2-large-xlsr-hindi

Shyam Sunder Kumar

Fine-tuned facebook/wav2vec2-large-xlsr-53 hindi using the Multilingual and code-switching ASR challenges for low resource Indian languages. When using this model, make sure that your speech input is sampled at 16kHz. The model can be used directly (without a language model) as follows: The model can be evaluated as follows on the hindi test data of Common Voice. The script used for training can be found Hindi ASR Fine Tuning Wav2Vec2

Open weights 316M parameters transformers