Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text to speech

drama-3-int4

by AK akhaliq/drama-3-int4

drama-3-int4 is an open-weight model for text to speech from AK, released under other. It has 6.9B parameters and a 262,144-token context. At 16-bit it needs about 16.5 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

The smallest working Drama 3. Unofficial int4 quantization of fishaudio/drama-3 — Fish Audio's 35B (3B active) multi-speaker TTS model — with real eval numbers, one-command serving, and a loader patch for SGLang-Omni.

Parameters6.9B
Context262,144
Weights24.0 GB
Licenseother
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve drama-3-int4 (6.9B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 13.7 GB 16.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 6.9 GB 8.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 3.4 GB 4.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 20, 2026.

drama-3-int4 on every accelerator the SAVRN Index prices, at every precision

Model Card

The smallest working Drama 3. Unofficial int4 quantization of fishaudio/drama-3 — Fish Audio's 35B (3B active) multi-speaker TTS model — with real eval numbers, one-command serving, and a loader patch for SGLang-Omni. - 22.1 GB download (vs 41.5 GB original) — experts, attention and deltanet layers int4; shared-expert MLP kept bf16 (see What we quantize) - Runs on Ampere (A100, sm80) — the FP8 original needs Hopper/Ada (fp8e4nv kernels); our int4 kernels (moewna16 + GPTQ-Marlin) don't - First drama-3 quant with published WER + speaker-similarity eval (below) - 5 verified sample types: plain TTS, voice cloning, [sighs]/[laughs] tags, long-form, Chinese Compared against the strongest…

Excerpt from the card by AK, licensed other.

Configuration

Architecture
FishOmniModel
Context length (tokens)
262,144
Layers
40
Hidden size
2,048
Feed-forward size
512
Attention heads
16
Key/value heads
2
Head dimension
256
Vocabulary size
252,288
Experts
256
Experts active per token
8
Model type
fish_omni
Quantization
drama3-int4

Identity and Version

Repository
akhaliq/drama-3-int4
Publisher
AK
Task
Text to speech
Modality
Audio
Library
Not stated by the source
Parameters
6.9B parameters
Languages
en, zh, ja, ko
Revision
1e1691e38980498effa4c8d3ba390536e8d24966
First published
2026-10-13
Last updated
2026-10-14

Files and Weights

68 files, 24.0 GB in total. The weights are 13 files totalling 24.0 GB in pth, safetensors.

Weights13 files · 24.0 GB
Configuration9 files · 6.8 MB
Tokenizer2 files · 20.9 MB
Documentation4 files · 36.5 KB
Other39 files · 23.5 MB
Repository1 file · 4.0 KB
Every file
FileTypeSizeSHA-256
codec.pthWeights1.9 GB 74fc41c5a715
model-00001-of-00012.safetensorsWeights2.0 GB 1d17414dc1ab
model-00002-of-00012.safetensorsWeights2.0 GB 77d83c82a83b
model-00003-of-00012.safetensorsWeights2.0 GB 607da15109e9
model-00004-of-00012.safetensorsWeights2.0 GB 476ebbc278d2
model-00005-of-00012.safetensorsWeights2.0 GB 204b11abc1e2
model-00006-of-00012.safetensorsWeights2.0 GB 2aa11e163646
model-00007-of-00012.safetensorsWeights2.0 GB 135e10983dee
model-00008-of-00012.safetensorsWeights2.0 GB 72ae08e3f7e6
model-00009-of-00012.safetensorsWeights2.0 GB fe327f32b05c
model-00010-of-00012.safetensorsWeights2.0 GB 82fc8904de8b
model-00011-of-00012.safetensorsWeights2.0 GB 8c627d098014
model-00012-of-00012.safetensorsWeights80.0 MB 2b72dc82f247
apply_patch.pyConfiguration5.7 KB —
config.jsonConfiguration6.0 KB —
eval.pyConfiguration9.5 KB —
eval/eval_results.jsonConfiguration4.2 KB —
eval_ab/eval_results.jsonConfiguration5.1 KB —
model.safetensors.index.jsonConfiguration6.6 MB —
quant_stats.jsonConfiguration439 B —
quantize.pyConfiguration20.9 KB —
special_tokens_map.jsonConfiguration102.8 KB —
LICENSEDocumentation19.7 KB —
README.mdDocumentation6.6 KB —
UPSTREAM_PR.mdDocumentation2.1 KB —
shared_expert_verdict.mdDocumentation8.1 KB —
chat_template.jinjaOther7.8 KB —
eval/int4/clone1.wavOther327.7 KB c991acfa4a34
eval/int4/ja1.wavOther409.6 KB 58f70b309766
eval/int4/long1.wavOther966.7 KB 22c7a2e66d74
eval/int4/plain1.wavOther561.2 KB a175ecc494c6
eval/int4/plain2.wavOther204.8 KB 44e698b77d76
eval/int4/plain3.wavOther446.5 KB 364270602f2c
eval/int4/tags1.wavOther1.1 MB 9bea49f6c67c
eval/int4/zh1.wavOther295.0 KB 5d4787119b7b
eval/theirs32/clone1.wavOther331.8 KB a842be837543
eval/theirs32/ja1.wavOther401.5 KB 66cb670ea7cc
eval/theirs32/long1.wavOther4.1 MB ed93d16e2bed
eval/theirs32/plain1.wavOther569.4 KB 15743a63d72e
eval/theirs32/plain2.wavOther188.5 KB 146a64a92cb9
eval/theirs32/plain3.wavOther471.1 KB 64429ea3e766
eval/theirs32/tags1.wavOther581.7 KB 60fa98239809
eval/theirs32/zh1.wavOther405.5 KB 8cac37b85463
eval_ab/fp8-anchor/tags1.wavOther811.1 KB f781af07217c
eval_ab/int4-experts-only/clone1.wavOther299.1 KB 0990dc3d9268
eval_ab/int4-experts-only/ja1.wavOther385.1 KB 427a8e523f61
eval_ab/int4-experts-only/long1.wavOther1.1 MB b187e8cb0122
eval_ab/int4-experts-only/plain1.wavOther602.2 KB a232f23542b5
eval_ab/int4-experts-only/plain2.wavOther184.4 KB da59d9a63429
eval_ab/int4-experts-only/plain3.wavOther573.5 KB dfe3a81d3087
eval_ab/int4-experts-only/tags1.wavOther553.0 KB 88953e90e7c0
eval_ab/int4-experts-only/zh1.wavOther421.9 KB 775614915340
eval_ab/int4-hybrid/clone1.wavOther327.7 KB c991acfa4a34
eval_ab/int4-hybrid/ja1.wavOther409.6 KB 58f70b309766
eval_ab/int4-hybrid/long1.wavOther966.7 KB 22c7a2e66d74
eval_ab/int4-hybrid/plain1.wavOther561.2 KB a175ecc494c6
eval_ab/int4-hybrid/plain2.wavOther204.8 KB 44e698b77d76
eval_ab/int4-hybrid/plain3.wavOther446.5 KB 364270602f2c
eval_ab/int4-hybrid/tags1.wavOther1.1 MB 9bea49f6c67c
eval_ab/int4-hybrid/zh1.wavOther295.0 KB 5d4787119b7b
samples/int4_clone.wavOther204.8 KB 44e698b77d76
samples/int4_long.wavOther1.1 MB f1d664de76b5
samples/int4_plain.wavOther561.2 KB a175ecc494c6
samples/int4_tags.wavOther688.2 KB 997e6a37d2f5
samples/int4_zh.wavOther417.8 KB e0f43c7a07c1
.gitattributesRepository4.0 KB —
tokenizer.jsonTokenizer20.8 MB 0e9b9db76b2f
tokenizer_config.jsonTokenizer103.6 KB —

License and Download

License
other
Access
Open weights, no gate
Download size
24.0 GB
Download from AK

Released by AK through its official repository on Hugging Face.

Built From

  • Derived from fishaudio/drama-3
  • Quantized from fishaudio/drama-3

Memory Requirements

PrecisionWeights in memory
As published24.0 GB
16-bit13.7 GB
8-bit6.9 GB
4-bit3.4 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About drama-3-int4

How much GPU memory does drama-3-int4 need?

About 16.5 GB at 16-bit and 4.1 GB at 4-bit: the weights (6.9B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run drama-3-int4 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is drama-3-int4 released under?

other, as its publisher declares it. Read the license text before commercial use.

What is drama-3-int4's context length?

262,144 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text to speech

higgs-tts-2-3b-base

Boson AI

Check our open-source repository https://github.com/boson-ai/higgs-audio for more details! We are open-sourcing Higgs TTS 2, a powerful audio foundation model pretrained on over 10 million hours of audio data and a diverse set of text data. Despite having no post-training or fine-tuning, Higgs TTS 2 excels in expressive audio generation, thanks to its deep language and acoustic understanding. On EmergentTTS-Eval, the model achieves win rates of 75.7% and 55.7% over "gpt-4o-mini-tts" on the "Emotions" and "Questions" categories, respectively. It also obtains state-of-the-art performance on traditional TTS benchmarks like Seed-TTS Eval and Emotional Speech Dataset (ESD). Moreover, the model…

Open weights other 5.8B parameters 2,048 tokens transformers

Model · Text to speech

MOSS-TTS-v1.5

OpenMOSS

MOSS-TTS-v1.5 is continued from MOSS-TTS 1.0. It preserves the main 1.0 capabilities, including zero-shot voice cloning, long-form speech generation, token-level duration control, Pinyin/IPA pronunciation control, multilingual synthesis, and code-switching. For the full 1.0 feature walkthrough, input schema, decoding hyperparameters, and evaluation tables, please refer to the MOSS-TTS 1.0 README. Compared with MOSS-TTS 1.0, v1.5 focuses on the following improvements: - Stronger multilingual synthesis with language tags: when the language field is omitted, v1.5 may improve some languages and regress slightly on others compared with 1.0. When the language is specified, v1.5 is stronger than…

Open weights apache-2.0 8.5B parameters 40,960 tokens

Model · Text to speech

higgs-tts-3-4b

Boson AI

Higgs TTS 3 is built for voice chat: it speaks, not just reads. It turns model responses into expressive conversational speech across 100+ languages, with zero-shot voice cloning and inline control over emotion, style, prosody, pauses, and sound effects. Higgs autoregressive decoder consumes interleaved text and audio tokens. Audio is encoded by the Higgs Tokenizer into 8 codebooks at 25 fps, staggered via a delay pattern, then mapped to backbone hidden states through a multi-codebook fused embedding. Output codes pass through a multi-codebook fused head, are de-delayed, and decoded back to waveform. The model reaches single-digit WER/CER on 102 languages, which split into · Chichewa/Nyanja…

Open weights other 4.7B parameters 32,768 tokens transformers

A trustremotecode packaging of bosonai/higgs-audio-v3-tts-4b that loads with plain transformers (no SGLang). The weights are the original checkpoint, copied unchanged; only a small modeling.py / configuration.py pair and an automap were added. The model is a standard Qwen3-4B backbone plus a fused multi-codebook audio embedding/head. Reference-audio encoding and waveform decoding use the transformers-native bosonai/higgs-audio-v2-tokenizer (higgsaudiov2tokenizer), loaded automatically on first use. Requires transformers >= 5.5. generatespeech returns a mono 24 kHz waveform as a CPU float32 tensor [L]. - Generation uses Higgs' delay pattern across 8 codebooks (vocab 1026, incl. BOC/EOC…

Open weights other 4.7B parameters 32,768 tokens transformers