SAVRN
Search Contact SAVRN

Open-weight model · Text to speech

hf-seamless-m4t-medium

by AI at Meta facebook/hf-seamless-m4t-medium

SeamlessM4T is a collection of models designed to provide high quality translation, allowing people from different linguistic communities to communicate effortlessly through speech and text. This repository hosts Hugging Face's implementation of SeamlessM4T.

Parameters
Context4,096
Weights4.8 GB
Licensecc-by-nc-4.0
AccessOpen weights
Monthly Downloads143.8k

Model Card

SeamlessM4T is a collection of models designed to provide high quality translation, allowing people from different linguistic communities to communicate effortlessly through speech and text. This repository hosts Hugging Face's implementation of SeamlessM4T. You can find the original weights, as well as a guide on how to run them in the original hub repositories (large and medium checkpoints). SeamlessM4T v2, an improved version of this version with a novel architecture, has been released here. This new model improves over SeamlessM4T v1 in quality as well as inference speed in speech generation tasks. SeamlessM4T v2 is also supported by Transformers, more on it in the model card of this…

Excerpt from the card by AI at Meta, licensed cc-by-nc-4.0.

Configuration

Architecture
SeamlessM4TModel
Context length (tokens)
4,096
Layers
12
Hidden size
1,024
Attention heads
16
Vocabulary size
256,206
Stored precision
float32
Model type
seamless_m4t

Identity and Version

Repository
facebook/hf-seamless-m4t-medium
Publisher
AI at Meta
Task
Text to speech
Modality
Audio
Library
transformers
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
ecf60d4df63baaac3f82ae6a7ad7adcb19dcb26c
First published
2023-08-28
Last updated
2023-12-08

Files and Weights

10 files, 4.8 GB in total. The weights are 1 file totalling 4.8 GB in bin.

Weights1 file · 4.8 GB
Configuration5 files · 18.9 KB
Tokenizer1 file · 39.0 KB
Documentation1 file · 6.8 KB
Other1 file · 4.9 MB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
pytorch_model.binWeights4.8 GB c4c909af3764
added_tokens.jsonConfiguration4.3 KB
config.jsonConfiguration2.6 KB
generation_config.jsonConfiguration5.4 KB
preprocessor_config.jsonConfiguration3.4 KB
special_tokens_map.jsonConfiguration3.3 KB
README.mdDocumentation6.8 KB
sentencepiece.bpe.modelOther4.9 MB 14bb8dfb35c0
.gitattributesRepository1.5 KB
tokenizer_config.jsonTokenizer39.0 KB

License and Download

License
cc-by-nc-4.0
Access
Open weights, no gate
Download size
4.8 GB
Download from AI at Meta

Released by AI at Meta through its official repository on Hugging Face. Read the license.

Memory Requirements

PrecisionWeights in memory
As published4.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About hf-seamless-m4t-medium

Can I use hf-seamless-m4t-medium commercially?

Not without separate permission. hf-seamless-m4t-medium is released under Creative Commons Attribution-NonCommercial 4.0. CC BY-NC 4.0 permits sharing and adapting with credit for non-commercial purposes only. Commercial use needs separate permission from the rights holder.

What is hf-seamless-m4t-medium's context length?

4,096 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text to speech

Kokoro-82M

Hexgrad

Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. You can run this basic cell on Google Colab. Listen to samples. For more languages and details, see Advanced Usage. Under the hood, kokoro uses misaki, a G2P library at https://github.com/hexgrad/misaki Model SHA256 Hash: 496dba118d1a58f5f3db2efc88dbdc216e0483fc89fe6e47ee1f2c53f18ad1e4 Data: Kokoro was trained exclusively on permissive/non-copyrighted audio data and IPA…

Open weights apache-2.0

Model · Text to speech

XTTS-v2

Coqui.ai

ⓍTTS is a Voice generation model that lets you clone voices into different languages by using just a quick 6-second audio clip. There is no need for an excessive amount of training data that spans countless hours. This is the same or similar model to what powers Coqui Studio and Coqui API. - Supports 17 languages. - Voice cloning with just a 6-second audio clip. - Emotion and style transfer by cloning. - Cross-language voice cloning. - Multi-lingual speech generation. - 24khz sampling rate. - 2 new languages; Hungarian and Korean - Architectural improvements for speaker conditioning. - Enables the use of multiple speaker references and interpolation between speakers. - Stability…

Open weights other coqui

Model · Text to speech

audio.cpp-gguf

Audio.cpp

This directory contains audio.cpp-native GGUF conversions of multiple speech models. These files are intended for use with audio.cpp. If you enjoy the project, please star audio.cpp on GitHub and this Hugging Face repository. For conversion details, supported layouts, direct-file loading, sidecar embedding, and the latest compatibility notes, see the audio.cpp GGUF guide: - https://github.com/0xShug0/audio.cpp/blob/main/docs/gguf.md!!! Converted and quantized packages are checked with automated metrics, but perceived quality can still differ for human listeners. Please validate the exact package, backend, and route to confirm the output is acceptable for your use case. The table lists the…

Open weights other audio.cpp

Model · Text to speech

chatterbox

Resemble AI

Chatterbox Multilingual V3 is the latest general-purpose multilingual TTS model in the Chatterbox family. It keeps the same 0.5B model size while improving speaker similarity, reducing hallucinations, and producing more natural, conversational speech across languages. V3 is designed for broad language coverage like V2, but with stronger stability and more expressive generation. It is the recommended multilingual model for users who want one voice cloning model that works across many languages. Try it in the Chatterbox Multilingual TTS V3 Space. Alongside V3, we are releasing the Single Language Pack: dedicated finetunes for priority languages where tighter quality control, stronger…

Open weights mit chatterbox

Model · Text to speech

F5-TTS

Yushen CHEN

Download F5-TTS or E2 TTS and place under ckpts/ Paper: F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching

Open weights cc-by-nc-4.0 f5-tts

Model · Text to speech

Kokoro-82M-v1.0-ONNX

ONNX Community

Kokoro is a frontier TTS model for its size of 82 million parameters (text in/audio out). First, install the kokoro-js library from NPM using: You can then generate speech as follows: Optionally, save the audio to a file: The model is resilient to quantization, enabling efficient high-quality speech synthesis at a fraction of the original model size.

Open weights apache-2.0 transformers.js