SAVRN
Search Contact SAVRN

Open-weight model · Speech recognition

VibeVoice-ASR

by Microsoft microsoft/VibeVoice-ASR

VibeVoice-ASR is a unified speech-to-text model designed to handle 60-minute long-form audio in a single pass, generating structured transcriptions containing Who (Speaker), When (Timestamps), and What (Content), with support for Customized Hotwords and over…

Parameters8.7B
Context
Weights17.3 GB
Licensemit
AccessOpen weights
Monthly Downloads735.8k

Runs On

What it takes to serve VibeVoice-ASR (8.7B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 17.3 GB 20.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 8.7 GB 10.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.3 GB 5.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on VibeVoice-ASR

If you need who said what and when from a long recording, this is the model we would size first. VibeVoice-ASR takes up to 60 minutes of continuous audio in a single pass inside a 64K token length and returns speaker, timestamp and content together, with custom hotwords and more than 50 languages. The 8.7 billion parameters weigh 17.3 GB at 16-bit and need 20.8 GB of memory, which fits one MI300X with 192 GB at $1.85 an hour; 8-bit needs 10.4 GB and 4-bit 5.2 GB. The rest of the card is headroom for parallel streams.

MIT is the license, dated 2026-01-21 from Microsoft, which clears commercial transcription products, changes and redistribution as long as the notice travels with the files. Before committing, note that the page lists no context length, so the publisher's 60-minute, 64K token figure is your ceiling, and that no SAVRN Index host prices it, so plan on your own card.

Model Card

By Microsoft, published under mit, revision d0c9efdb8d61.

VibeVoice-ASR is a unified speech-to-text model designed to handle 60-minute long-form audio in a single pass, generating structured transcriptions containing Who (Speaker), When (Timestamps), and What (Content), with support for Customized Hotwords and over 50 languages.

Code: microsoft/VibeVoice
Demo: VibeVoice-ASR-Demo
Report: VibeVoice-ASR Technical Report
Finetuning: Finetuning
vLLM: vLLM-VibeVoice-ASR

Key Features

Read the full model card (255 words)

Configuration

Architecture
VibeVoiceForASRTraining
Model type
vibevoice

Identity and Version

Repository
microsoft/VibeVoice-ASR
Publisher
Microsoft
Task
Speech recognition
Modality
Audio
Library
transformers
Parameters
8.7B parameters
Languages
en, zh, es, pt, de, ja, ko, fr
Revision
d0c9efdb8d614685062c04425d91e01b6f37d944
First published
2026-01-21
Last updated
2026-01-27

Files and Weights

17 files, 17.3 GB in total. The weights are 8 files totalling 17.3 GB in safetensors.

Weights8 files · 17.3 GB
Configuration2 files · 123.7 KB
Documentation1 file · 4.3 KB
Other5 files · 1.2 MB
Repository1 file · 199 B
Every file
FileTypeSizeSHA-256
model-00001-of-00008.safetensorsWeights2.5 GB 5548c67885d4
model-00002-of-00008.safetensorsWeights2.4 GB 163023c61a3f
model-00003-of-00008.safetensorsWeights2.5 GB 4e021702dfac
model-00004-of-00008.safetensorsWeights2.5 GB b17657bb151d
model-00005-of-00008.safetensorsWeights2.5 GB 0ed4e457268f
model-00006-of-00008.safetensorsWeights2.5 GB 6de8246bb042
model-00007-of-00008.safetensorsWeights1.5 GB a2ba6960d994
model-00008-of-00008.safetensorsWeights1.1 GB 1b9d9b328f85
config.jsonConfiguration3.5 KB
model.safetensors.index.jsonConfiguration120.2 KB
README.mdDocumentation4.3 KB
figures/DER.jpgOther62.7 KB
figures/VibeVoice_ASR_archi.pngOther149.5 KB c5973094212c
figures/cpWER.jpgOther68.5 KB
figures/language_distribution_horizontal.pngOther888.4 KB 1151d7587c66
figures/tcpWER.jpgOther64.3 KB
.gitattributesRepository199 B

License and Download

License
mit
Access
Open weights, no gate
Download size
17.3 GB
Download from Microsoft

Released by Microsoft through its official repository on Hugging Face. Read the license.

Built From

  • Described by arXiv:2601.18184

Memory Requirements

PrecisionWeights in memory
As published17.3 GB
16-bit17.3 GB
8-bit8.7 GB
4-bit4.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About VibeVoice-ASR

How much GPU memory does VibeVoice-ASR need?

About 20.8 GB at 16-bit and 5.2 GB at 4-bit: the weights (8.7B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run VibeVoice-ASR on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use VibeVoice-ASR commercially?

Yes. VibeVoice-ASR is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

Similar Models

Model · Speech recognition

Voxtral-Mini-4B-Realtime-2602

Mistral AI_

Voxtral Mini 4B Realtime 2602 is a multilingual, realtime speech-transcription model and among the first open-source solutions to achieve accuracy comparable to offline systems with a delay of = 3600 / 0.8 = 45000. In theory, you should be able to record with no limit; in practice, pre-allocations of RoPE parameters among other things limits --max-model-len. For the best user experience, we recommend to simply instantiate vLLM with the default parameters which will automatically set a maximum model length of 131072 (~ca. 3h).

Open weights apache-2.0 4.4B parameters 131,072 tokens vllm

Model · Speech recognition

Qwen3-ASR-1.7B

Qwen

The Qwen3-ASR family includes Qwen3-ASR-1.7B and Qwen3-ASR-0.6B, which support language identification and ASR for 52 languages and dialects. Both leverage large-scale speech training data and the strong audio understanding capability of their foundation model, Qwen3-Omni. Experiments show that the 1.7B version achieves state-of-the-art performance among open-source ASR models and is competitive with the strongest proprietary commercial APIs. Here are the main features: Novel and strong forced alignment Solution: We introduce Qwen3-ForcedAligner-0.6B, which supports timestamp prediction for arbitrary units within up to 5 minutes of speech in 11 languages. Evaluations show its timestamp…

Open weights apache-2.0 2.3B parameters

Model · Speech recognition

seamless-m4t-v2-large

AI at Meta

SeamlessM4T is our foundational all-in-one Massively Multilingual and Multimodal Machine Translation model delivering high-quality translation for speech and text in nearly 100 languages. SeamlessM4T models support the tasks of: - Automatic speech recognition (ASR). - 101 languages for speech input. - 96 Languages for text input/output. - 35 languages for speech output. We are releasing SeamlessM4T v2, an updated version with our novel UnitY2 architecture. This new model improves over SeamlessM4T v1 in quality as well as inference speed in speech generation tasks. The v2 version of SeamlessM4T is a multitask adaptation of our novel UnitY2 architecture. Unity2 with its hierarchical…

Open weights cc-by-nc-4.0 2.3B parameters 4,096 tokens transformers

Model · Speech recognition

cohere-transcribe-03-2026-mlx-4bit

David Larrea

Quantized MLX weights for beshkenadze/cohere-transcribe-03-2026-mlx-fp16. - model.safetensors - config.json - tokenizer.model - tokenizerconfig.json - preprocessorconfig.json - specialtokensmap.json - keymap.json - conversionsummary.json This checkpoint has been re-validated against the current Swift and Python MLX runtimes. Verified semantic parity on an English fixture: - official CUDA reference path (transformers native Cohere ASR) Fastest and smallest, but introduces a lexical regression on the repo sample (Kaldi → Khaldi). - Generated from the Swift-compatible fp16 checkpoint beshkenadze/cohere-transcribe-03-2026-mlx-fp16. - This repository contains inference artifacts only. Refer to…

Open weights apache-2.0 2.1B parameters mlx

Model · Speech recognition

cohere-transcribe-03-2026-mlx-8bit

David Larrea

Quantized MLX weights for beshkenadze/cohere-transcribe-03-2026-mlx-fp16. - model.safetensors - config.json - tokenizer.model - tokenizerconfig.json - preprocessorconfig.json - specialtokensmap.json - keymap.json - conversionsummary.json This checkpoint has been re-validated against the current Swift and Python MLX runtimes. Verified semantic parity on an English fixture: - official CUDA reference path (transformers native Cohere ASR) Matches fp16 on the repo sample while reducing memory substantially. - Generated from the Swift-compatible fp16 checkpoint beshkenadze/cohere-transcribe-03-2026-mlx-fp16. - This repository contains inference artifacts only. Refer to the upstream Cohere model…

Open weights apache-2.0 2.1B parameters mlx

Model · Speech recognition

whisper-large-v3

OpenAI

Whisper is a state-of-the-art model for automatic speech recognition (ASR) and speech translation, proposed in the paper Robust Speech Recognition via Large-Scale Weak Supervision by Alec Radford et al. from OpenAI. Trained on >5M hours of labeled data, Whisper demonstrates a strong ability to generalise to many datasets and domains in a zero-shot setting. Whisper large-v3 has the same architecture as the previous large and large-v2 models, except for the following minor differences: 1. The spectrogram input uses 128 Mel frequency bins instead of 80 The Whisper large-v3 model was trained on 1 million hours of weakly labeled audio and 4 million hours of pseudo-labeled audio collected using…

Open weights apache-2.0 1.5B parameters transformers