microsoft__wavlm-base is an open-weight model from Allinsama. Its published files total 377.6 MB.
The base model pretrained on 16kHz sampled speech audio. When using the model, make sure that your speech input is also sampled at 16kHz. Note: This model does not have a tokenizer as it was pretrained on audio alone.
Model Card
The base model pretrained on 16kHz sampled speech audio. When using the model, make sure that your speech input is also sampled at 16kHz. Note: This model does not have a tokenizer as it was pretrained on audio alone. In order to use this model speech recognition, a tokenizer should be created and the model should be fine-tuned on labeled text data. Check out this blog for more in-detail explanation of how to fine-tune the model. The model was pre-trained on 960h of Librispeech. Authors: Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng…
Excerpt from the card by Allinsama.
Configuration
- Architecture
- WavLMModel
- Layers
- 12
- Hidden size
- 768
- Feed-forward size
- 3,072
- Attention heads
- 12
- Vocabulary size
- 32
- Stored precision
- float32
- Model type
- wavlm
Identity and Version
- Repository
- Allinsama/microsoft__wavlm-base
- Publisher
- Allinsama
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- en
- Revision
- a0bdfe4d2d514a80de4590de8db75b5793b881c6
- First published
- 2026-10-18
- Last updated
- 2026-10-18
Files and Weights
6 files, 377.6 MB in total. The weights are 1 file totalling 377.6 MB in bin.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| pytorch_model.bin | Weights | 377.6 MB | b41ab60fdcdc |
| config.json | Configuration | 2.2 KB | — |
| preprocessor_config.json | Configuration | 215 B | — |
| MIRROR_README.md | Documentation | 408 B | — |
| README.md | Documentation | 3.8 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 377.6 MB
Released by Allinsama through its official repository on Hugging Face.
Built From
- Described by arXiv:2110.13900
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 377.6 MB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.