SAVRN
Search Contact SAVRN

Open-weight model · Speech recognition

filipino-wav2vec2-l-xls-r-300m-official

by John Karl Tumpalan Khalsuu/filipino-wav2vec2-l-xls-r-300m-official

This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the filipinovoice dataset.

Parameters
Context
Weights1.3 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads1.8M

Model Card

By John Karl Tumpalan, published under apache-2.0, revision 06e33a5630c5.

This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the filipinovoice dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 0.0003 - trainbatchsize: 8 - evalbatchsize: 8 - gradientaccumulationsteps: 2 - totaltrainbatchsize: 16 - lrschedulertype: linear - lrschedulerwarmupsteps: 500 - numepochs: 30 - mixedprecisiontraining: Native AMP - Transformers 4.11.3 - Pytorch 1.10.0+cu113 - Datasets 1.18.3 - Tokenizers 0.10.3

Read John Karl Tumpalan's full model card

This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the filipino_voice dataset. It achieves the following results on the evaluation set: - Loss: 0.4672 - Wer: 0.2922

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training: - learning_rate: 0.0003 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - gradient_accumulation_steps: 2 - total_train_batch_size: 16 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 500 - num_epochs: 30 - mixed_precision_training: Native AMP

Training results

Training Loss Epoch Step Validation Loss Wer
3.3671 2.09 400 0.5584 0.5987
0.48 4.19 800 0.4244 0.4195
0.2796 6.28 1200 0.3742 0.3765
0.1916 8.38 1600 0.4291 0.3667
0.1463 10.47 2000 0.3745 0.3415
0.1165 12.57 2400 0.4472 0.3407
0.0955 14.66 2800 0.4269 0.3290
0.0823 16.75 3200 0.4608 0.3475
0.0709 18.85 3600 0.4706 0.3281
0.0603 20.94 4000 0.4380 0.3183
0.0527 23.04 4400 0.4473 0.3067
0.0449 25.13 4800 0.4550 0.3029
0.041 27.23 5200 0.4671 0.3020
0.0358 29.32 5600 0.4672 0.2922

Framework versions

  • Transformers 4.11.3
  • Pytorch 1.10.0+cu113
  • Datasets 1.18.3
  • Tokenizers 0.10.3

Configuration

Architecture
Wav2Vec2ForCTC
Layers
24
Hidden size
1,024
Feed-forward size
4,096
Attention heads
16
Vocabulary size
31
Stored precision
float32
Model type
wav2vec2

Identity and Version

Repository
Khalsuu/filipino-wav2vec2-l-xls-r-300m-official
Publisher
John Karl Tumpalan
Task
Speech recognition
Modality
Audio
Library
transformers
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
06e33a5630c543cffb68a011fef6eea64dcc09d8
First published
2022-05-13
Last updated
2022-05-13

Files and Weights

13 files, 1.3 GB in total. The weights are 2 files totalling 1.3 GB in bin.

Weights2 files · 1.3 GB
Configuration4 files · 2.2 KB
Tokenizer2 files · 519 B
Documentation1 file · 2.3 KB
Other2 files · 15.8 KB
Repository2 files · 1.2 KB
Every file
FileTypeSizeSHA-256
pytorch_model.binWeights1.3 GB 20d9bde03634
training_args.binWeights2.9 KB 26195e48d53e
added_tokens.jsonConfiguration23 B
config.jsonConfiguration1.7 KB
preprocessor_config.jsonConfiguration240 B
special_tokens_map.jsonConfiguration309 B
README.mdDocumentation2.3 KB
runs/May13_03-26-02_b93b174d3505/1652412449.0586677/events.out.tfevents.1652412449.b93b174d3505.96.1Other4.6 KB 3a6d70dfa4e4
runs/May13_03-26-02_b93b174d3505/events.out.tfevents.1652412449.b93b174d3505.96.0Other11.2 KB 3a21f081ee77
.gitattributesRepository1.2 KB
.gitignoreRepository13 B
tokenizer_config.jsonTokenizer260 B
vocab.jsonTokenizer259 B

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
1.3 GB
Download from John Karl Tumpalan

Released by John Karl Tumpalan through its official repository on Hugging Face. Read the license.

Built From

  • Trained on (disclosed) filipino_voice

Memory Requirements

PrecisionWeights in memory
As published1.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About filipino-wav2vec2-l-xls-r-300m-official

Can I use filipino-wav2vec2-l-xls-r-300m-official commercially?

Yes. filipino-wav2vec2-l-xls-r-300m-official is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Speech recognition

wav2vec2-large-xlsr-53-japanese

Jonatas Grosman

Fine-tuned facebook/wav2vec2-large-xlsr-53 on Japanese using the train and validation splits of Common Voice 6.1, CSS10 and JSUT. When using this model, make sure that your speech input is sampled at 16kHz. This model has been fine-tuned thanks to the GPU credits generously given by the OVHcloud:) The script used for training can be found here: https://github.com/jonatasgrosman/wav2vec2-sprint The model can be used directly (without a language model) as follows... Using the HuggingSound library: The model can be evaluated as follows on the Japanese test data of Common Voice. In the table below I report the Word Error Rate (WER) and the Character Error Rate (CER) of the model. I ran the…

Open weights apache-2.0 transformers

Model · Speech recognition

whisperkit-coreml

Argmax

WhisperKit is part of Argmax OSS, an On-device Speech AI SDK for Apple Silicon: https://github.com/argmaxinc/argmax-oss-swift Check out the WhisperKit paper and presentation from ICML 2025: https://icml.cc/virtual/2025/47854 For real-time transcription with speakers and custom vocabulary, check out Argmax Pro SDK: https://www.argmaxinc.com/blog/argmax-sdk-2

Open weights mit whisperkit

Model · Speech recognition

speaker-diarization-3.1

Pyannote

Using this open-source model in production? Consider switching to pyannoteAI for better and faster options. This pipeline is the same as pyannote/speaker-diarization-3.0 except it removes the problematic use of onnxruntime. Both speaker segmentation and embedding now run in pure PyTorch. This should ease deployment and possibly speed up inference. It requires pyannote.audio version 3.1 or higher. It ingests mono audio sampled at 16kHz and outputs speaker diarization as an Annotation instance: - stereo or multi-channel audio files are automatically downmixed to mono by averaging the channels. - audio files sampled at a different rate are resampled to 16kHz automatically upon loading. 1.…

Access requested at publisher mit pyannote-audio

Fine-tuned facebook/wav2vec2-large-xlsr-53 on Portuguese using the train and validation splits of Common Voice 6.1. When using this model, make sure that your speech input is sampled at 16kHz. This model has been fine-tuned thanks to the GPU credits generously given by the OVHcloud:) The script used for training can be found here: https://github.com/jonatasgrosman/wav2vec2-sprint The model can be used directly (without a language model) as follows... Using the HuggingSound library: 1. To evaluate on mozilla-foundation/commonvoice60 with split test 2. To evaluate on speech-recognition-community-v2/devdata If you want to cite this model you can use this

Open weights apache-2.0 transformers

Model · Speech recognition

speaker-diarization-community-1

Pyannote

This pipeline ingests mono audio sampled at 16kHz and outputs speaker diarization. - stereo or multi-channel audio files are automatically downmixed to mono by averaging the channels. - audio files sampled at a different rate are resampled to 16kHz automatically upon loading. The main improvements brought by Community-1 are: - improved speaker assignment and counting - simpler reconciliation with transcription timestamps with exclusive speaker diarization - easy offline use (i.e. without internet connection) - (optionally) hosted on pyannoteAI cloud 1. pip install pyannote.audio 3. Create access token at hf.co/settings/tokens. Out of the box, Community-1 is much better than…

Access requested at publisher cc-by-4.0 pyannote-audio

Model · Speech recognition

wav2vec2-large-xlsr-53-russian

Jonatas Grosman

Fine-tuned facebook/wav2vec2-large-xlsr-53 on Russian using the train and validation splits of Common Voice 6.1 and CSS10. When using this model, make sure that your speech input is sampled at 16kHz. This model has been fine-tuned thanks to the GPU credits generously given by the OVHcloud:) The script used for training can be found here: https://github.com/jonatasgrosman/wav2vec2-sprint The model can be used directly (without a language model) as follows... Using the HuggingSound library: 1. To evaluate on mozilla-foundation/commonvoice60 with split test 2. To evaluate on speech-recognition-community-v2/devdata If you want to cite this model you can use this

Open weights apache-2.0 transformers