For usage instructions follow openai/whisper-large-v3-turbo. Note for faster-whisper vocab changes make model.ismultilingual and suppresstokens wrong. Please adjust the code as required if you want to use this with faster-whisper. Turbo finetune with japanese tokenizer. Full finetune trained 2^19 steps, batch size 64. Smaller vocab with ~1.6x bytes/token allows faster speed with 4 layers vs 2 layer distil (10% larger decoder). Benchmarks. Short form slightly behind v0.2 (trained less?) but long form much better. Also trained for lyrics but untested. Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC)
Whisper finetune for Japanese focused on general/anime domains. For usage instructions follow openai/whisper-large-v3-turbo. Due to vocab changes ctranslate2>=4.7.1 required for faster-whisper.
Runs On
What it takes to serve whisper-ja-760M (756M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 1.5 GB | 1.8 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 0.8 GB | 0.9 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.4 GB | 0.5 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.
Model Card
Whisper finetune for Japanese focused on general/anime domains. For usage instructions follow openai/whisper-large-v3-turbo. Due to vocab changes ctranslate2>=4.7.1 required for faster-whisper. For inference engines with hardcoded vocab, the token embedding can be padded. Finetuned from turbo with pruned vocab, indices can be found in mapping.txt. Trained decoder only for 2^20 steps, batch size 64. Using a 45000 hour corpus (largest source is 17000 of filtered reazonspeech-all) with custom mixing ratio and augmentation to maintain long form performance and timestamps. Benchmarks. Competitive/SOTA on test sets, slightly better than 1.5B on short form, worse on long form. Also trained for…
Excerpt from the card by Efwkjn.
Configuration
- Architecture
- WhisperForConditionalGeneration
- Layers
- 32
- Vocabulary size
- 10,240
- Stored precision
- float32
- Model type
- whisper
Identity and Version
- Repository
- efwkjn/whisper-ja-760M
- Publisher
- Efwkjn
- Task
- Speech recognition
- Modality
- Audio
- Library
- Not stated by the source
- Parameters
- 756M parameters
- Languages
- ja
- Revision
- 00daeaf3b79a85c5c52474147cc80b4370deae7f
- First published
- 2026-07-26
- Last updated
- 2026-09-18
Files and Weights
15 files, 1.5 GB in total. The weights are 1 file totalling 1.5 GB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors | Weights | 1.5 GB | e477931ae793 |
| added_tokens.json | Configuration | 33.3 KB | — |
| config.json | Configuration | 1.1 KB | — |
| generation_config.json | Configuration | 3.2 KB | — |
| normalizer.json | Configuration | 52.7 KB | — |
| preprocessor_config.json | Configuration | 340 B | — |
| special_tokens_map.json | Configuration | 2.2 KB | — |
| BENCH.md | Documentation | 86.5 KB | — |
| README.md | Documentation | 1.3 KB | — |
| mapping.txt | Other | 66.2 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
| merges.txt | Tokenizer | 60.4 KB | — |
| tokenizer.json | Tokenizer | 614.7 KB | — |
| tokenizer_config.json | Tokenizer | 282.8 KB | — |
| vocab.json | Tokenizer | 146.6 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 1.5 GB
Released by Efwkjn through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 1.5 GB |
| 16-bit | 1.5 GB |
| 8-bit | 0.8 GB |
| 4-bit | 0.4 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About whisper-ja-760M
How much GPU memory does whisper-ja-760M need?
About 1.8 GB at 16-bit and 0.5 GB at 4-bit: the weights (756M parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run whisper-ja-760M on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Similar Models
Whisper is a state-of-the-art model for automatic speech recognition (ASR) and speech translation, proposed in the paper Robust Speech Recognition via Large-Scale Weak Supervision by Alec Radford et al. from OpenAI. Trained on >5M hours of labeled data, Whisper demonstrates a strong ability to generalise to many datasets and domains in a zero-shot setting. Whisper large-v3-turbo is a finetuned version of a pruned Whisper large-v3. In other words, it's the exact same model, except that the number of decoding layers have reduced from 32 to 4. As a result, the model is way faster, at the expense of a minor quality degradation. You can find more details about it in this GitHub discussion.…
Fine-tuned openai/whisper-large-v3-turbo on Monsoon Hindi ASR data using LoRA (r=32, alpha=64). English capabilities preserved with <10% relative degradation across all benchmarks. LoRA's structural separation (frozen base + low-rank adapters) provides a natural safeguard against catastrophic forgetting.
/ Improve list spacing / / Badge alignment consistency / Nemotron 3.5 ASR is a multilingual, streaming Automatic Speech Recognition (ASR) model engineered to deliver high-quality multilingual transcription across both low-latency streaming and high-throughput batch workloads. Developed by NVIDIA, this 600M parameter model transcribes speech into text with native support for punctuation and capitalization, and offers runtime flexibility with configurable chunk sizes, including 80ms, 160ms, 320ms, 560ms, and 1120ms. By leveraging a state-of-the-art Cache-Aware FastConformer-RNNT architecture, the model eliminates redundant overlapping computations common in traditional "buffered" streaming.…
An equal-weight average of the epoch 6, 7, 8, 9 and 10 checkpoints of No training was done here, and inference costs exactly what one model costs. Like its ingredient, this model has no reported WER or CER and cannot have one. That run trains on every held-out hour the project has, including the SAPC2 dev split the rest of this family scores against. Averaging its epochs does not create a set to measure on. So this checkpoint rests on a bet rather than a measurement, and it is worth same soup of the same five epochs was worth 0.27 CER points — 6.06% against 6.33% for the best single epoch. That is the whole of the evidence. It is evidence from a different architecture (RNN-T, not TDT) on…
nvidia/parakeet-tdt-0.6b-v3 fine-tuned on all 1,047.7 hours this project holds: SAPC1 train and dev, SAPC2 train, the SAPC2 dev split the rest of this family scores against, 103.1 hours of synthetic dysarthric speech, 79.2 hours recovered by force-aligning and cutting recordings past the 45-second training cap, and 15.5 hours of AtaxiaUK and HeyJay!, which are outside the challenge corpora and make this an unconstrained-track model. This model has no reported WER or CER, and cannot have one. Every held-out hour is in its training data. That was the point: the hyperparameters were settled on the sibling runs that do hold out a dev split, and this run spends that split as training data…