Model · Speech recognition
OpenAI
Whisper is a pre-trained model for automatic speech recognition (ASR) and speech translation. Trained on 680k hours of labelled data, Whisper models demonstrate a strong ability to generalise to many datasets and domains without the need for fine-tuning. Whisper was proposed in the paper Robust Speech Recognition via Large-Scale Weak Supervision by Alec Radford et al from OpenAI. The original code repository can be found here. Disclaimer: Content for this model card has partly been written by the Hugging Face team, and parts of it were copied and pasted from the original model card. Whisper is a Transformer based encoder-decoder model, also referred to as a sequence-to-sequence model. It…
Open weights
apache-2.0
242M parameters
transformers
This Python package provides an efficient way to perform forced alignment between text and audio using Hugging Face's pretrained models. it also features an improved implementation to use much less memory than TorchAudio forced alignment API. The model checkpoint uploaded here is a conversion from torchaudio to HF Transformers for the MMS-300M checkpoint trained on forced alignment dataset
Open weights
cc-by-nc-4.0
315M parameters
transformers
This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the private datasets in 2 stages - firstly was fine-tuned on a small dataset with good samples Then the obtained model was fine-tuned on a large dataset with the small good dataset, with various samples from different sources, and with an unlabeled dataset that was weakly labeled using a previously trained model. (weakly labeled data wasn't used in validation set) on small dataset on large dataset on small dataset on large dataset The following hyperparameters were used during training: - learningrate: 0.0003 - trainbatchsize: 8 - evalbatchsize: 8 - distributedtype: multi-GPU - numdevices: 2 - gradientaccumulationsteps: 4…
Open weights
315M parameters
transformers
This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the FTSpeech dataset, being a dataset of 1,800 hours of transcribed speeches from the Danish parliament. The model achieves the following WER scores (lower is better): The use of this model needs to adhere to this license from the Danish Parliament.
Open weights
other
315M parameters
transformers
You can test this model online with the Space for Romanian Speech Recognition The model ranked TOP-1 on Romanian Speech Recognition during HuggingFace's Robust Speech Challenge: This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the Common Voice 8.0 - Romanian subset dataset, with extra training data from Romanian Speech Synthesis dataset. Without the 5-gram Language Model optimization, it achieves the following results on the evaluation set (Common Voice 8.0, Romanian subset, test split): The architecture is based on facebook/wav2vec2-xls-r-300m with a speech recognition CTC head and an added 5-gram language model (using pyctcdecode and kenlm) trained on the Romanian…
Open weights
apache-2.0
315M parameters
transformers
ATTENTION! Metrics (float16) using evaluate library with batchsize=1
Open weights
apache-2.0
315M parameters
transformers
