SAVRN
Search Contact SAVRN

Open-weight model · Translation

madlad400-3b-mt

by Google google/madlad400-3b-mt

MADLAD-400-3B-MT is a multilingual machine translation model based on the T5 architecture that was trained on 1 trillion tokens covering over 450 languages using publicly available data. It is competitive with models that are significantly larger.

Parameters2.9B
Context
Weights15.6 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads60.8k

Runs On

What it takes to serve madlad400-3b-mt (2.9B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 5.9 GB 7.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 2.9 GB 3.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 1.5 GB 1.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By Google, published under apache-2.0, revision fa184c675da0.

Model Card for MADLAD-400-3B-MT

Table of Contents

  1. TL;DR
  2. Model Details
  3. Usage
  4. Uses
  5. Bias, Risks, and Limitations
  6. Training Details
  7. Evaluation
  8. Environmental Impact
  9. Citation

TL;DR

MADLAD-400-3B-MT is a multilingual machine translation model based on the T5 architecture that was trained on 1 trillion tokens covering over 450 languages using publicly available data. It is competitive with models that are significantly larger.

Disclaimer: Juarez Bochi, who was not involved in this research, converted the original weights and wrote the contents of this model card based on the original paper and Flan-T5.

Model Details

Model Description

Usage

Find below some example scripts on how to use the model:

Using the Pytorch model with transformers

Read the full model card (769 words)

Configuration

Architecture
T5ForConditionalGeneration
Vocabulary size
256,000
Model type
t5

Identity and Version

Repository
google/madlad400-3b-mt
Publisher
Google
Task
Translation
Modality
Text
Library
transformers
Parameters
2.9B parameters
Languages
en, ru, es, fr, de, it, pt, pl
Revision
fa184c675da0b5c9e1c8694fccd4e12e2d422094
First published
2023-11-27
Last updated
2023-11-27

Files and Weights

13 files, 15.7 GB in total. The weights are 4 files totalling 15.6 GB in gguf, safetensors.

Weights4 files · 15.6 GB
Configuration4 files · 1.3 KB
Tokenizer3 files · 21.1 MB
Documentation1 file · 9.7 KB
Repository1 file · 1.7 KB
Every file
FileTypeSizeSHA-256
model-q2k.ggufWeights965.5 MB abab3b4cf39c
model-q3k.ggufWeights1.3 GB 6d9850c77c46
model-q4k.ggufWeights1.7 GB ea6e5531a3e9
model.safetensorsWeights11.8 GB 66ff5f8fcaf9
added_tokens.jsonConfiguration4 B
config.jsonConfiguration749 B
generation_config.jsonConfiguration142 B
special_tokens_map.jsonConfiguration414 B
README.mdDocumentation9.7 KB
.gitattributesRepository1.7 KB
spiece.modelTokenizer4.4 MB ef11ac9a22c7
tokenizer.jsonTokenizer16.6 MB a2799ccc696b
tokenizer_config.jsonTokenizer830 B

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
15.6 GB
Download from Google

Released by Google through its official repository on Hugging Face. Read the license.

Built From

  • Described by arXiv:2309.04662
  • Trained on (disclosed) allenai/MADLAD-400

Memory Requirements

PrecisionWeights in memory
As published15.6 GB
16-bit5.9 GB
8-bit2.9 GB
4-bit1.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About madlad400-3b-mt

How much GPU memory does madlad400-3b-mt need?

About 7.1 GB at 16-bit and 1.8 GB at 4-bit: the weights (2.9B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run madlad400-3b-mt on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use madlad400-3b-mt commercially?

Yes. madlad400-3b-mt is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Translation

t5-3b

T5 community

The developers of the Text-To-Text Transfer Transformer (T5) write: T5-3B is the checkpoint with 3 billion parameters. The developers write in a blog post that the model: See the blog post and research paper for further details. The model is pre-trained on the Colossal Clean Crawled Corpus (C4), which was developed and released in the context of the same research paper as T5. The model was pre-trained on a on a multi-task mixture of unsupervised (1.) and supervised tasks (2.). Thereby, the following datasets were being used for (1.) and (2.): 1. Datasets used for Unsupervised denoising objective: 2. Datasets used for Supervised text-to-text language modeling objective - CoLA Warstadt et…

Open weights apache-2.0 2.9B parameters transformers

Model · Translation

Hy-MT2-1.8B

Tencent

English | 中文 Hy-MT2 is a family of “fast-thinking” multilingual translation models designed for complex real-world scenarios. It includes three model sizes: 1.8B, 7B, and 30B-A3B (MoE), all of which support translation among 33 languages and effectively follow translation instructions in multiple languages. For on-device deployment, AngelSlim 1.25-bit extreme quantization reduces the storage requirement of the 1.8B model to only 440 MB and improves inference speed by 1.5x. Multi-dimensional evaluations show that Hy-MT2 delivers outstanding performance across general, real-world business, domain-specific, and instruction-following translation tasks. The 7B and 30B-A3B models outperform…

Open weights apache-2.0 2B parameters 262,144 tokens transformers

Model · Translation

HY-MT1.5-1.8B-FP8

Tencent

Hunyuan Translation Model Version 1.5 includes a 1.8B translation model, HY-MT1.5-1.8B, and a 7B translation model, HY-MT1.5-7B. Both models focus on supporting mutual translation across 33 languages and incorporating 5 ethnic and dialect variations. Among them, HY-MT1.5-7B is an upgraded version of our WMT25 championship model, optimized for explanatory translation and mixed-language scenarios, with newly added support for terminology intervention, contextual translation, and formatted translation. Despite having less than one-third the parameters of HY-MT1.5-7B, HY-MT1.5-1.8B delivers translation performance comparable to its larger counterpart, achieving both high speed and high quality.…

Open weights 1.8B parameters 262,144 tokens transformers

Model · Translation

t5-large

T5 community

The developers of the Text-To-Text Transfer Transformer (T5) write: T5-Large is the checkpoint with 770 million parameters. The developers write in a blog post that the model: See the blog post and research paper for further details. The model is pre-trained on the Colossal Clean Crawled Corpus (C4), which was developed and released in the context of the same research paper as T5. The model was pre-trained on a on a multi-task mixture of unsupervised (1.) and supervised tasks (2.). Thereby, the following datasets were being used for (1.) and (2.): 1. Datasets used for Unsupervised denoising objective: 2. Datasets used for Supervised text-to-text language modeling objective - CoLA Warstadt…

Open weights apache-2.0 738M parameters transformers

This model is a fine-tuned checkpoint of mBART-large-50. mbart-large-50-many-to-many-mmt is fine-tuned for multilingual machine translation. It was introduced in Multilingual Translation with Extensible Multilingual Pretraining and Finetuning paper. The model can translate directly between any pair of 50 languages. To translate into a target language, the target language id is forced as the first generated token. To force the target language id as the first generated token, pass the forcedbostokenid parameter to the generate method. See the model hub to look for more fine-tuned versions. Arabic (arAR), Czech (csCZ), German (deDE), English (enXX), Spanish (esXX), Estonian (etEE), Finnish…

Open weights 611M parameters 1,024 tokens transformers

Model · Translation

mbart-large-en-ro

AI at Meta

This is mbart-large-cc25, finetuned on wmtenro. It scores BLEU 28.1 without post processing and BLEU 38 with postprocessing. Instructions in romanianpostprocessing.md Original Code: https://github.com/pytorch/fairseq/tree/master/examples/mbart Docs: https://huggingface.co/transformers/master/modeldoc/mbart.html

Open weights mit 611M parameters 1,024 tokens transformers