nocturne-v1-teacher

Model · Audio classification

nocturne-v1.2d-teacher

Stratus Labs

Audio Spectrogram Transformer, ~86M parameters, 2,196 output columns. This is the first candidate in the Nocturne line to clear our pre-committed release gate against the v1 teacher. It got there by fixing two supervision bugs, not by adding data — which is the most useful thing in this card. Read the limitations section before deploying it. On an unseen recording site this model is substantially worse than v1, and our much smaller distilled student beats it outright on the very test it was released for. Both are stated with numbers below. Identical 13,710-clip held-out test set, per-class thresholds calibrated on validation, scored over the 2,182 name-aligned core classes. Rows are…

Model · Audio classification

ast-finetuned-audioset-10-10-0.4593

Massachusetts Institute of Technology

Audio Spectrogram Transformer (AST) model fine-tuned on AudioSet. It was introduced in the paper AST: Audio Spectrogram Transformer by Gong et al. and first released in this repository. Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Audio Spectrogram Transformer is equivalent to ViT, but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks. You can use the raw model for classifying audio into one of the AudioSet classes. See…

This model is a fine-tuned version of MIT/ast-finetuned-audioset-10-10-0.4593 on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 1e-05 - trainbatchsize: 16 - evalbatchsize: 16 - lrschedulertype: linear - lrschedulerwarmupsteps: 10 - numepochs: 4 - mixedprecisiontraining: Native AMP - Transformers 5.16.1 - Pytorch 2.11.0+cu128 - Datasets 4.8.5 - Tokenizers 0.23.1

Model · Audio classification

ast-finetuned-audioset-14-14-0.443

Massachusetts Institute of Technology

Audio Spectrogram Transformer (AST) model fine-tuned on AudioSet. It was introduced in the paper AST: Audio Spectrogram Transformer by Gong et al. and first released in this repository. Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model so this model card has been written by the Hugging Face team. The Audio Spectrogram Transformer is equivalent to ViT, but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks. You can use the raw model for classifying audio into one of the AudioSet classes. See…

Model · Audio classification

discogs-maest-10s-pw-129e

Music Technology Group (Universitat Pompeu Fabra)

MAEST is a family of Transformer models based on PASST and focused on music analysis applications. The MAEST models are also available for inference in the Essentia library and for inference and training in the official repository. You can try the MAEST interactive demo on replicate. MAEST is a music audio representation model pre-trained on the task of music style classification. According to the evaluation reported in the original paper, it reports good performance in several downstream music analysis tasks. The MAEST models can make predictions for a taxonomy of 400 music styles derived from the public metadata of Discogs. The MAEST models have reported good performance in downstream…

Model · Audio classification

ced-base

Speech Team, Xiaomi MiLM Plus

CED are simple ViT-Transformer-based models for audio tagging, achieving sota performance on Audioset. Notable differences from other available models include: 1. Simplification for finetuning: Batchnormalization of Mel-Spectrograms. During finetuning one does not need to first compute mean/variance over the dataset, which is common for AST. 1. Support for variable length inputs. Most other models use a static time-frequency position embedding, which hinders the model's generalization to segments shorter than 10s. Many previous transformers simply pad their input to 10s in order to avoid the performance impact, which in turn slows down training/inference drastically. 1. Training/Inference…