Skip to page content
SAVRN
Search Plan a project

Open-weight model · Feature extraction

whisper-cluster

by Keisuke Miyamoto KeisukeMiyamoto/whisper-cluster

whisper-cluster is an open-weight model for feature extraction from Keisuke Miyamoto. Its published files total 92.2 GB.

This repository contains a 500-cluster K-means codebook for Whisper large-v3-turbo encoder representations, trained on Japanese audio from Lambda Audio Corpus.

Parameters—
Context—
Weights92.2 GB
License—
AccessOpen weights
Monthly Downloads—

Model Card

This repository contains a 500-cluster K-means codebook for Whisper large-v3-turbo encoder representations, trained on Japanese audio from Lambda Audio Corpus. Each 1,280-dimensional audio frame can be assigned to its nearest cluster center to produce a discrete unit ID from 0 to 499. These IDs can be used as targets for speech representation learning. They are learned acoustic units, not text tokens or labeled phonemes. The codebook was trained on 18,000,004 sampled frames from 199.89 hours of accepted audio. The repository includes the cluster centers, training features, and metadata. Original audio and transcripts are not included. The files are stored under codebook/. Only centroids.npy…

Excerpt from the card by Keisuke Miyamoto.

Identity and Version

Repository
KeisukeMiyamoto/whisper-cluster
Publisher
Keisuke Miyamoto
Task
Feature extraction
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
ja
Revision
ec5b7f2752c918cfbf4fce2af9b2704b2eef3727
First published
2026-09-27
Last updated
2026-09-27

Files and Weights

8 files, 92.2 GB in total.

Configuration2 files · 3.1 KB
Documentation1 file · 19.9 KB
Other4 files · 92.2 GB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
codebook/codebook.jsonConfiguration1.7 KB —
codebook/features.jsonConfiguration1.4 KB —
README.mdDocumentation19.9 KB —
codebook/audio.jsonlOther6.0 MB —
codebook/centroids.npyOther2.6 MB f0dff5219b78
codebook/chunks.npyOther7.2 KB 8c97f8914588
codebook/features.f32Other92.2 GB 9aabea8c8f84
.gitattributesRepository1.6 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download from Keisuke Miyamoto

Released by Keisuke Miyamoto through its official repository on Hugging Face.

Built From

Similar Models

Model · Feature extraction

all-MiniLM-L6-v2

Joshua

https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2 with ONNX weights to be compatible with Transformers.js. If you haven't already, you can install the Transformers.js JavaScript library from NPM using: You can then use the model to compute embeddings like this: You can convert this Tensor to a nested JavaScript array using.tolist(): Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).

Open weights apache-2.0 512 tokens transformers.js

Model · Feature extraction

bge-base-en-v1.5

Joshua

https://huggingface.co/BAAI/bge-base-en-v1.5 with ONNX weights to be compatible with Transformers.js. If you haven't already, you can install the Transformers.js JavaScript library from NPM using: You can then use the model to compute embeddings, as follows: You can also use the model for retrieval. For example: Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).

Open weights mit 512 tokens transformers.js

For more details please refer to our Github: FlagEmbedding. If you are looking for a model that supports more languages, longer texts, and other retrieval methods, you can try using bge-m3. FlagEmbedding focuses on retrieval-augmented LLMs, consisting of the following projects currently: - 1/30/2024: Release BGE-M3, a new member to BGE model series! M3 stands for Multi-linguality (100+ languages), Multi-granularities (input length up to 8192), Multi-Functionality (unification of dense, lexical, multi-vec/colbert retrieval). It is the first embedding model which supports all three retrieval methods, achieving new SOTA on multi-lingual (MIRACL) and cross-lingual (MKQA) benchmarks. Technical…

Open weights mit 512 tokens sentence-transformers

Model · Feature extraction

wavlm-large

Microsoft

The large model pretrained on 16kHz sampled speech audio. When using the model, make sure that your speech input is also sampled at 16kHz. Note: This model does not have a tokenizer as it was pretrained on audio alone. In order to use this model speech recognition, a tokenizer should be created and the model should be fine-tuned on labeled text data. Check out this blog for more in-detail explanation of how to fine-tune the model. - 60,000 hours of Libri-Light - 10,000 hours of GigaSpeech - 24,000 hours of VoxPopuli Authors: Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin…

Open weights transformers

Model · Feature extraction

clap-htsat-unfused

LAION eV

The abstract of the paper states that: You can use this model for zero shot audio classification or extracting audio and/or textual features. You can also get the audio and text embeddings using ClapModel If you are using this model for your work, please consider citing the original paper

Open weights apache-2.0 514 tokens transformers