Skip to page content
SAVRN
Search Plan a project

Open-weight model · Speech recognition

whisper-small-16-lora-cs-42

by Dehan Wijesinghe dehanns/whisper-small-16-lora-cs-42

whisper-small-16-lora-cs-42 is an open-weight model for speech recognition from Dehan Wijesinghe. Its published files total 70.0 MB. It draws 13 downloads a month.

This is a standalone rank-16 code-switching LoRA adapter for openai/whisper-small. It was trained directly from the frozen base model using the new rich-codeswitched/train.csv split. The Sinhala rank-32 adapter was not loaded, changed, or retrained.

Parameters—
Context—
Weights64.1 MB
License—
AccessOpen weights
Monthly Downloads13

Model Card

This is a standalone rank-16 code-switching LoRA adapter for openai/whisper-small. It was trained directly from the frozen base model using the new rich-codeswitched/train.csv split. The Sinhala rank-32 adapter was not loaded, changed, or retrained. The best epoch was selected only by validation WER. The untouched test split was evaluated once after selection. Load this adapter on top of openai/whisper-small with PEFT. For the independent-weighted experiment, combine this adapter with the separate rank-32 Sinhala adapter only at inference time using validation-selected alpha/beta weights.

Excerpt from the card by Dehan Wijesinghe.

Identity and Version

Repository
dehanns/whisper-small-16-lora-cs-42
Publisher
Dehan Wijesinghe
Task
Speech recognition
Modality
Audio
Library
peft
Parameters
Not stated by the source
Languages
si, en
Revision
ceee78a6e60fcc7cd434eeb49361ecb321eb9021
First published
2026-09-01
Last updated
2026-10-13

Files and Weights

69 files, 70.0 MB in total. The weights are 14 files totalling 64.1 MB in bin, pt, pth, safetensors.

Weights14 files · 64.1 MB
Configuration35 files · 302.6 KB
Tokenizer9 files · 5.4 MB
Documentation5 files · 17.1 KB
Other5 files · 126.5 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
adapter_model.safetensorsWeights7.1 MB 1a90200ef6b3
code_switch_adapter/best/adapter_model.safetensorsWeights7.1 MB 1a90200ef6b3
code_switch_adapter/checkpoint-750/adapter_model.safetensorsWeights7.1 MB b5f7f0456781
code_switch_adapter/checkpoint-750/optimizer.ptWeights14.3 MB eda80a84d228
code_switch_adapter/checkpoint-750/rng_state.pthWeights14.2 KB a35bc233aab1
code_switch_adapter/checkpoint-750/scheduler.ptWeights1.1 KB 7a1080553238
code_switch_adapter/checkpoint-750/training_args.binWeights5.6 KB c9de58876c75
code_switch_adapter/checkpoint-936/adapter_model.safetensorsWeights7.1 MB 2c940c88cfef
code_switch_adapter/checkpoint-936/optimizer.ptWeights14.3 MB fafc45d89d3a
code_switch_adapter/checkpoint-936/rng_state.pthWeights14.2 KB b582981fd92c
code_switch_adapter/checkpoint-936/scheduler.ptWeights1.1 KB 48f8ed8278e6
code_switch_adapter/checkpoint-936/training_args.binWeights5.6 KB c9de58876c75
code_switch_adapter/last/adapter_model.safetensorsWeights7.1 MB 2c940c88cfef
code_switch_adapter/last/training_args.binWeights5.6 KB c9de58876c75
adapter_config.jsonConfiguration839 B —
added_tokens.jsonConfiguration34.6 KB —
code_switch_adapter/.complete.jsonConfiguration96 B —
code_switch_adapter/all_results.jsonConfiguration203 B —
code_switch_adapter/best/adapter_config.jsonConfiguration839 B —
code_switch_adapter/best/added_tokens.jsonConfiguration34.6 KB —
code_switch_adapter/best/lora_train_report.jsonConfiguration2.6 KB —
code_switch_adapter/best/normalizer.jsonConfiguration52.7 KB —
code_switch_adapter/best/preprocessor_config.jsonConfiguration339 B —
code_switch_adapter/best/rich_codeswitched_test_metrics.jsonConfiguration540 B —
code_switch_adapter/best/special_tokens_map.jsonConfiguration2.2 KB —
code_switch_adapter/checkpoint-750/adapter_config.jsonConfiguration839 B —
code_switch_adapter/checkpoint-750/preprocessor_config.jsonConfiguration339 B —
code_switch_adapter/checkpoint-750/trainer_state.jsonConfiguration6.7 KB —
code_switch_adapter/checkpoint-936/adapter_config.jsonConfiguration839 B —
code_switch_adapter/checkpoint-936/preprocessor_config.jsonConfiguration339 B —
code_switch_adapter/checkpoint-936/trainer_state.jsonConfiguration8.1 KB —
code_switch_adapter/environment.jsonConfiguration249 B —
code_switch_adapter/epoch_metrics.jsonConfiguration978 B —
code_switch_adapter/last/adapter_config.jsonConfiguration839 B —
code_switch_adapter/last/added_tokens.jsonConfiguration34.6 KB —
code_switch_adapter/last/normalizer.jsonConfiguration52.7 KB —
code_switch_adapter/last/preprocessor_config.jsonConfiguration339 B —
code_switch_adapter/last/special_tokens_map.jsonConfiguration2.2 KB —
code_switch_adapter/lora_train_report.jsonConfiguration2.6 KB —
code_switch_adapter/seed_report.jsonConfiguration121 B —
code_switch_adapter/test_evaluation/metrics.jsonConfiguration540 B —
code_switch_adapter/train_results.jsonConfiguration203 B —
code_switch_adapter/training_config.yamlConfiguration1.5 KB —
code_switch_adapter/validation_history.jsonConfiguration978 B —
lora_train_report.jsonConfiguration2.6 KB —
normalizer.jsonConfiguration52.7 KB —
preprocessor_config.jsonConfiguration339 B —
rich_codeswitched_test_metrics.jsonConfiguration540 B —
special_tokens_map.jsonConfiguration2.2 KB —
README.mdDocumentation905 B —
code_switch_adapter/best/README.mdDocumentation905 B —
code_switch_adapter/checkpoint-750/README.mdDocumentation5.1 KB —
code_switch_adapter/checkpoint-936/README.mdDocumentation5.1 KB —
code_switch_adapter/last/README.mdDocumentation5.1 KB —
code_switch_adapter/best/rich_codeswitched_test_predictions.csvOther36.5 KB —
code_switch_adapter/runs/Sep24_10-00-02_modal/events.out.tfevents.1790244003.modal.2.0Other16.7 KB be0e3a4ae726
code_switch_adapter/test_evaluation/predictions.csvOther36.5 KB —
code_switch_adapter/training_log.jsonlOther246 B —
rich_codeswitched_test_predictions.csvOther36.5 KB —
.gitattributesRepository1.5 KB —
code_switch_adapter/best/merges.txtTokenizer493.9 KB —
code_switch_adapter/best/tokenizer_config.jsonTokenizer282.7 KB —
code_switch_adapter/best/vocab.jsonTokenizer1.0 MB —
code_switch_adapter/last/merges.txtTokenizer493.9 KB —
code_switch_adapter/last/tokenizer_config.jsonTokenizer282.7 KB —
code_switch_adapter/last/vocab.jsonTokenizer1.0 MB —
merges.txtTokenizer493.9 KB —
tokenizer_config.jsonTokenizer282.7 KB —
vocab.jsonTokenizer1.0 MB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
64.1 MB
Download from Dehan Wijesinghe

Released by Dehan Wijesinghe through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published64.1 MB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Similar Models

Model · Speech recognition

wav2vec2-large-xlsr-53-japanese

Jonatas Grosman

Fine-tuned facebook/wav2vec2-large-xlsr-53 on Japanese using the train and validation splits of Common Voice 6.1, CSS10 and JSUT. When using this model, make sure that your speech input is sampled at 16kHz. This model has been fine-tuned thanks to the GPU credits generously given by the OVHcloud:) The script used for training can be found here: https://github.com/jonatasgrosman/wav2vec2-sprint The model can be used directly (without a language model) as follows... Using the HuggingSound library: The model can be evaluated as follows on the Japanese test data of Common Voice. In the table below I report the Word Error Rate (WER) and the Character Error Rate (CER) of the model. I ran the…

Open weights apache-2.0 transformers

Model · Speech recognition

whisperkit-coreml

Argmax

WhisperKit is part of Argmax OSS, an On-device Speech AI SDK for Apple Silicon: https://github.com/argmaxinc/argmax-oss-swift Check out the WhisperKit paper and presentation from ICML 2025: https://icml.cc/virtual/2025/47854 For real-time transcription with speakers and custom vocabulary, check out Argmax Pro SDK: https://www.argmaxinc.com/blog/argmax-sdk-2

Open weights mit whisperkit

Model · Speech recognition

speaker-diarization-3.1

Pyannote

Using this open-source model in production? Consider switching to pyannoteAI for better and faster options. This pipeline is the same as pyannote/speaker-diarization-3.0 except it removes the problematic use of onnxruntime. Both speaker segmentation and embedding now run in pure PyTorch. This should ease deployment and possibly speed up inference. It requires pyannote.audio version 3.1 or higher. It ingests mono audio sampled at 16kHz and outputs speaker diarization as an Annotation instance: - stereo or multi-channel audio files are automatically downmixed to mono by averaging the channels. - audio files sampled at a different rate are resampled to 16kHz automatically upon loading. 1.…

Access requested at publisher mit pyannote-audio

Model · Speech recognition

speaker-diarization-community-1

Pyannote

This pipeline ingests mono audio sampled at 16kHz and outputs speaker diarization. - stereo or multi-channel audio files are automatically downmixed to mono by averaging the channels. - audio files sampled at a different rate are resampled to 16kHz automatically upon loading. The main improvements brought by Community-1 are: - improved speaker assignment and counting - simpler reconciliation with transcription timestamps with exclusive speaker diarization - easy offline use (i.e. without internet connection) - (optionally) hosted on pyannoteAI cloud 1. pip install pyannote.audio 3. Create access token at hf.co/settings/tokens. Out of the box, Community-1 is much better than…

Access requested at publisher cc-by-4.0 pyannote-audio

Model · Speech recognition

faster-whisper-small

Systran

This repository contains the conversion of openai/whisper-small to the CTranslate2 model format. This model can be used in CTranslate2 or projects based on CTranslate2 such as faster-whisper. The original model was converted with the following command: Note that the model weights are saved in FP16. This type can be changed when the model is loaded using the computetype option in CTranslate2. For more information about the original model, see its model card.

Open weights mit ctranslate2

Fine-tuned facebook/wav2vec2-large-xlsr-53 on Portuguese using the train and validation splits of Common Voice 6.1. When using this model, make sure that your speech input is sampled at 16kHz. This model has been fine-tuned thanks to the GPU credits generously given by the OVHcloud:) The script used for training can be found here: https://github.com/jonatasgrosman/wav2vec2-sprint The model can be used directly (without a language model) as follows... Using the HuggingSound library: 1. To evaluate on mozilla-foundation/commonvoice60 with split test 2. To evaluate on speech-recognition-community-v2/devdata If you want to cite this model you can use this

Open weights apache-2.0 transformers