source languages: nl; target languages: en; OPUS readme: nl-en; dataset: opus; model: transformer-align; pre-processing: normalization + SentencePiece.
Open-weight model · Translation
opus-mt-en-fr
by Helsinki-NLP Research Group Helsinki-NLP/opus-mt-en-fr
source languages: en; target languages: fr; OPUS readme: en-fr; dataset: opus; model: transformer-align; pre-processing: normalization + SentencePiece.
Parameters—
Context512
Weights900.8 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads182.6k
Model Card
By Helsinki-NLP Research Group, published under apache-2.0, revision dd7f6540a7a4.
source languages: en; target languages: fr; OPUS readme: en-fr; dataset: opus; model: transformer-align; pre-processing: normalization + SentencePiece.
Read Helsinki-NLP Research Group's full model card
- source languages: en
- target languages: fr
-
OPUS readme: en-fr
-
dataset: opus
- model: transformer-align
- pre-processing: normalization + SentencePiece
- download original weights: opus-2020-02-26.zip
- test set translations: opus-2020-02-26.test.txt
- test set scores: opus-2020-02-26.eval.txt
Benchmarks
| testset | BLEU | chr-F |
|---|---|---|
| newsdiscussdev2015-enfr.en.fr | 33.8 | 0.602 |
| newsdiscusstest2015-enfr.en.fr | 40.0 | 0.643 |
| newssyscomb2009.en.fr | 29.8 | 0.584 |
| news-test2008.en.fr | 27.5 | 0.554 |
| newstest2009.en.fr | 29.4 | 0.577 |
| newstest2010.en.fr | 32.7 | 0.596 |
| newstest2011.en.fr | 34.3 | 0.611 |
| newstest2012.en.fr | 31.8 | 0.592 |
| newstest2013.en.fr | 33.2 | 0.589 |
| Tatoeba.en.fr | 50.5 | 0.672 |
Configuration
- Architecture
- MarianMTModel
- Context length (tokens)
- 512
- Layers
- 6
- Vocabulary size
- 59,514
- Model type
- marian
Identity and Version
- Repository
- Helsinki-NLP/opus-mt-en-fr
- Publisher
- Helsinki-NLP Research Group
- Task
- Translation
- Modality
- Text
- Library
- transformers
- Parameters
- Not stated by the source
- Languages
- tf, jax, en, fr
- Revision
- dd7f6540a7a48a7f4db59e5c0b9c42c8eea67f18
- First published
- 2022-03-02
- Last updated
- 2024-02-14
Files and Weights
11 files, 903.7 MB in total. The weights are 3 files totalling 900.8 MB in bin, h5, msgpack.
Weights3 files · 900.8 MB
Configuration2 files · 1.7 KB
Tokenizer2 files · 1.3 MB
Documentation1 file · 1.2 KB
Other2 files · 1.6 MB
Repository1 file · 391 B
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| flax_model.msgpack | Weights | 298.7 MB | 7b7ebb1b554e |
| pytorch_model.bin | Weights | 300.8 MB | cc1de10b4934 |
| tf_model.h5 | Weights | 301.3 MB | c860b5d50a25 |
| config.json | Configuration | 1.4 KB | — |
| generation_config.json | Configuration | 293 B | — |
| README.md | Documentation | 1.2 KB | — |
| source.spm | Other | 778.4 KB | — |
| target.spm | Other | 802.4 KB | — |
| .gitattributes | Repository | 391 B | — |
| tokenizer_config.json | Tokenizer | 42 B | — |
| vocab.json | Tokenizer | 1.3 MB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 900.8 MB
Download from Helsinki-NLP Research Group
Released by Helsinki-NLP Research Group through its official repository on Hugging Face. Read the license.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 900.8 MB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About opus-mt-en-fr
Can I use opus-mt-en-fr commercially?
Yes. opus-mt-en-fr is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
What is opus-mt-en-fr's context length?
512 tokens, from the maximum position embeddings in its published configuration.
Similar Models
This is the model card of NLLB-200's distilled 600M variant. Here are the metrics for that particular checkpoint. - Information about training algorithms, parameters, fairness constraints or other applied approaches, and features. The exact training algorithm, data and the strategies to handle data imbalances for high and low resource languages that were used to train NLLB-200 is described in the paper. - Paper or other resource for more information NLLB Team et al, No Language Left Behind: Scaling Human-Centered Machine Translation, Arxiv, 2022 - Where to send questions or comments about the model: https://github.com/facebookresearch/fairseq/issues • Model performance measures: NLLB-200…
source languages: en; target languages: ru; OPUS readme: en-ru; dataset: opus; model: transformer-align; pre-processing: normalization + SentencePiece.
This model can be used for translation and text-to-text generation. CONTENT WARNING: Readers should be aware this section contains content that is disturbing, offensive, and can propagate historical and current stereotypes. Significant research has explored bias and fairness issues with language models (see, e.g., Sheng et al. (2021) and Bender et al. (2021)). Further details about the dataset for this model can be found in the OPUS readme: en-de
hfname: kor-eng - sourcelanguages: kor - targetlanguages: eng - opusreadmeurl: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/kor-eng/README.md - originalrepo: Tatoeba-Challenge - srcconstituents: {'korHani', 'korHang', 'korLatn', 'kor'} - tgtconstituents: {'eng'} - srcmultilingual: False - tgtmultilingual: False - urlmodel: https://object.pouta.csc.fi/Tatoeba-MT-models/kor-eng/opus-2020-06-17.zip - urltestset: https://object.pouta.csc.fi/Tatoeba-MT-models/kor-eng/opus-2020-06-17.test.txt - srcalpha3: kor - tgtalpha3: eng - shortpair: ko-en - chrF2score: 0.588 - brevitypenalty: 0.9590000000000001 - reflen: 17711.0 - srcname: Korean - tgtname: English - traindate…
source languages: de; target languages: en; OPUS readme: de-en; dataset: opus; model: transformer-align; pre-processing: normalization + SentencePiece.