SAVRN
Search Contact SAVRN

Open-weight model · Translation

mbart-large-en-ro

by AI at Meta facebook/mbart-large-en-ro

This is mbart-large-cc25, finetuned on wmtenro. It scores BLEU 28.1 without post processing and BLEU 38 with postprocessing.

Parameters611M
Context1,024
Weights4.9 GB
Licensemit
AccessOpen weights
Monthly Downloads101.7k

Runs On

What it takes to serve mbart-large-en-ro (611M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 1.2 GB 1.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.6 GB 0.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.3 GB 0.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By AI at Meta, published under mit, revision 3f6705eea8ae.

This is mbart-large-cc25, finetuned on wmtenro. It scores BLEU 28.1 without post processing and BLEU 38 with postprocessing. Instructions in romanianpostprocessing.md Original Code: https://github.com/pytorch/fairseq/tree/master/examples/mbart Docs: https://huggingface.co/transformers/master/modeldoc/mbart.html

Read AI at Meta's full model card

This is mbart-large-cc25, finetuned on wmt_en_ro.

It scores BLEU 28.1 without post processing and BLEU 38 with postprocessing. Instructions in romanian_postprocessing.md

Original Code: https://github.com/pytorch/fairseq/tree/master/examples/mbart

Docs: https://huggingface.co/transformers/master/model_doc/mbart.html

Finetuning Code: examples/seq2seq/finetune.py (as of Aug 20, 2020)

Configuration

Context length (tokens)
1,024
Layers
12
Vocabulary size
250,027
Model type
mbart

Identity and Version

Repository
facebook/mbart-large-en-ro
Publisher
AI at Meta
Task
Translation
Modality
Text
Library
transformers
Parameters
611M parameters
Languages
en, ro
Revision
3f6705eea8aef516fdbdbf3ec20f63a6a522a6ae
First published
2022-03-02
Last updated
2023-09-11

Files and Weights

9 files, 4.9 GB in total. The weights are 3 files totalling 4.9 GB in bin, h5, safetensors.

Weights3 files · 4.9 GB
Configuration1 file · 1.3 KB
Tokenizer1 file · 9.1 MB
Documentation1 file · 476 B
Other2 files · 10.1 MB
Repository1 file · 399 B
Every file
FileTypeSizeSHA-256
model.safetensorsWeights1.2 GB 60f91af617e2
pytorch_model.binWeights1.2 GB f52791571919
tf_model.h5Weights2.4 GB 51449b7a9d58
config.jsonConfiguration1.3 KB
README.mdDocumentation476 B
sentence.bpe.modelOther5.1 MB
sentencepiece.bpe.modelOther5.1 MB
.gitattributesRepository399 B
tokenizer.jsonTokenizer9.1 MB

License and Download

License
mit
Access
Open weights, no gate
Download size
4.9 GB
Download from AI at Meta

Released by AI at Meta through its official repository on Hugging Face. Read the license.

Memory Requirements

PrecisionWeights in memory
As published4.9 GB
16-bit1.2 GB
8-bit0.6 GB
4-bit0.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About mbart-large-en-ro

How much GPU memory does mbart-large-en-ro need?

About 1.5 GB at 16-bit and 0.4 GB at 4-bit: the weights (611M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run mbart-large-en-ro on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use mbart-large-en-ro commercially?

Yes. mbart-large-en-ro is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

What is mbart-large-en-ro's context length?

1,024 tokens, from the maximum position embeddings in its published configuration.

Similar Models

This model is a fine-tuned checkpoint of mBART-large-50. mbart-large-50-many-to-many-mmt is fine-tuned for multilingual machine translation. It was introduced in Multilingual Translation with Extensible Multilingual Pretraining and Finetuning paper. The model can translate directly between any pair of 50 languages. To translate into a target language, the target language id is forced as the first generated token. To force the target language id as the first generated token, pass the forcedbostokenid parameter to the generate method. See the model hub to look for more fine-tuned versions. Arabic (arAR), Czech (csCZ), German (deDE), English (enXX), Spanish (esXX), Estonian (etEE), Finnish…

Open weights 611M parameters 1,024 tokens transformers

Model · Translation

t5-large

T5 community

The developers of the Text-To-Text Transfer Transformer (T5) write: T5-Large is the checkpoint with 770 million parameters. The developers write in a blog post that the model: See the blog post and research paper for further details. The model is pre-trained on the Colossal Clean Crawled Corpus (C4), which was developed and released in the context of the same research paper as T5. The model was pre-trained on a on a multi-task mixture of unsupervised (1.) and supervised tasks (2.). Thereby, the following datasets were being used for (1.) and (2.): 1. Datasets used for Unsupervised denoising objective: 2. Datasets used for Supervised text-to-text language modeling objective - CoLA Warstadt…

Open weights apache-2.0 738M parameters transformers

This is the model card of IndicTrans2 En-Indic Distilled 200M variant. Please refer to section 7.6: Distilled Models in the TMLR submission for further details on model training, data and metrics. Please refer to the github repository for a detail description on how to use HF compatible IndicTrans2 models for inference. - New RoPE based IndicTrans2 models which are capable of handling sequence lengths upto 2048 tokens are available here - These models can be used by just changing the modelname parameter. Please read the model card of the RoPE-IT2 models for more information about the generation. - It is recommended to run these models with flashattention2 for efficient generation. If you…

Access requested at publisher mit 275M parameters transformers

Neural machine translation model for translating from English (en) to Bulgarian (bg). This model is part of the OPUS-MT project, an effort to make neural machine translation models widely available and accessible for many languages in the world. All models are originally trained using the amazing framework of Marian NMT, an efficient NMT implementation written in pure C++. The models have been converted to pyTorch using the transformers library by huggingface. Training data is taken from OPUS and training pipelines use the procedures of OPUS-MT-train. You can also use OPUS-MT models with the transformers pipelines, for example: The work is supported by the European Language Grid as pilot…

Open weights cc-by-4.0 238M parameters 1,024 tokens transformers

Neural machine translation model for translating from Turkish (tr) to English (en). This model is part of the OPUS-MT project, an effort to make neural machine translation models widely available and accessible for many languages in the world. All models are originally trained using the amazing framework of Marian NMT, an efficient NMT implementation written in pure C++. The models have been converted to pyTorch using the transformers library by huggingface. Training data is taken from OPUS and training pipelines use the procedures of OPUS-MT-train. You can also use OPUS-MT models with the transformers pipelines, for example: The work is supported by the European Language Grid as pilot…

Open weights cc-by-4.0 235M parameters 1,024 tokens transformers

Model · Translation

t5-base

T5 community

The developers of the Text-To-Text Transfer Transformer (T5) write: T5-Base is the checkpoint with 220 million parameters. The developers write in a blog post that the model: See the blog post and research paper for further details. The model is pre-trained on the Colossal Clean Crawled Corpus (C4), which was developed and released in the context of the same research paper as T5. The model was pre-trained on a on a multi-task mixture of unsupervised (1.) and supervised tasks (2.). Thereby, the following datasets were being used for (1.) and (2.): 1. Datasets used for Unsupervised denoising objective: 2. Datasets used for Supervised text-to-text language modeling objective - CoLA Warstadt et…

Open weights apache-2.0 223M parameters transformers