open-vakgyata

Model · Audio classification

distil-wav2vec2-adult-child-cls-37m

Bookbot

DistilWav2Vec2 Adult/Child Speech Classifier is an audio classification model based on the wav2vec 2.0 architecture. This model is a distilled version of wav2vec2-adult-child-cls on a private adult/child speech classification dataset. This model was trained using HuggingFace's PyTorch framework. All training was done on a Tesla P100, provided by Kaggle. Training metrics were logged via Tensorboard. The model achieves the following results on evaluation: The following hyperparameters were used during training: - learningrate: 3e-05 - trainbatchsize: 32 - evalbatchsize: 32 - seed: 42 - gradientaccumulationsteps: 4 - totaltrainbatchsize: 128 - optimizer: Adam with betas=(0.9,0.999) and…

Model · Audio classification

ast-finetuned-speech-commands-v2

Massachusetts Institute of Technology

Audio Spectrogram Transformer (AST) model fine-tuned on Speech Commands v2. It was introduced in the paper AST: Audio Spectrogram Transformer by Gong et al. and first released in this repository. Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Audio Spectrogram Transformer is equivalent to ViT, but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks. You can use the raw model for classifying audio into one of the Speech…

Model · Audio classification

dasheng-base

Speech Team, Xiaomi MiLM Plus

Dasheng (Deep Audio-Signal Holistic Embeddings), or “大声” ("great sound"), is a general-purpose audio encoder trained on a large-scale self-supervised learning task. Dasheng is designed to capture rich audio information across various domains, including speech, music, and environmental sounds. The model is trained on 272,356 hours of diverse audio data with 1.2 billion parameters, and exhibits significant performance gains on the HEAR benchmark. Dasheng outperforms previous works on CREMA-D, LibriCount, Speech Commands, VoxLingua, and competes well in music and environmental sound classification tasks. examplefinetuneesc50.ipynb demonstrates how to train a linear head on the ESC-50 dataset…

Model · Audio classification

ced-base

Speech Team, Xiaomi MiLM Plus

CED are simple ViT-Transformer-based models for audio tagging, achieving sota performance on Audioset. Notable differences from other available models include: 1. Simplification for finetuning: Batchnormalization of Mel-Spectrograms. During finetuning one does not need to first compute mean/variance over the dataset, which is common for AST. 1. Support for variable length inputs. Most other models use a static time-frequency position embedding, which hinders the model's generalization to segments shorter than 10s. Many previous transformers simply pad their input to 10s in order to avoid the performance impact, which in turn slows down training/inference drastically. 1. Training/Inference…

Model · Audio classification

discogs-maest-10s-pw-129e

Music Technology Group (Universitat Pompeu Fabra)

MAEST is a family of Transformer models based on PASST and focused on music analysis applications. The MAEST models are also available for inference in the Essentia library and for inference and training in the official repository. You can try the MAEST interactive demo on replicate. MAEST is a music audio representation model pre-trained on the task of music style classification. According to the evaluation reported in the original paper, it reports good performance in several downstream music analysis tasks. The MAEST models can make predictions for a taxonomy of 400 music styles derived from the public metadata of Discogs. The MAEST models have reported good performance in downstream…

Model · Audio classification

ast-finetuned-audioset-14-14-0.443

Massachusetts Institute of Technology

Audio Spectrogram Transformer (AST) model fine-tuned on AudioSet. It was introduced in the paper AST: Audio Spectrogram Transformer by Gong et al. and first released in this repository. Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Audio Spectrogram Transformer is equivalent to ViT, but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks. You can use the raw model for classifying audio into one of the AudioSet classes. See…