t5-large

Model · Translation

mbart-large-50-many-to-many-mmt

AI at Meta

This model is a fine-tuned checkpoint of mBART-large-50. mbart-large-50-many-to-many-mmt is fine-tuned for multilingual machine translation. It was introduced in Multilingual Translation with Extensible Multilingual Pretraining and Finetuning paper. The model can translate directly between any pair of 50 languages. To translate into a target language, the target language id is forced as the first generated token. To force the target language id as the first generated token, pass the forcedbostokenid parameter to the generate method. See the model hub to look for more fine-tuned versions. Arabic (arAR), Czech (csCZ), German (deDE), English (enXX), Spanish (esXX), Estonian (etEE), Finnish…

Model · Translation

mbart-large-en-ro

AI at Meta

This is mbart-large-cc25, finetuned on wmtenro. It scores BLEU 28.1 without post processing and BLEU 38 with postprocessing. Instructions in romanianpostprocessing.md Original Code: https://github.com/pytorch/fairseq/tree/master/examples/mbart Docs: https://huggingface.co/transformers/master/modeldoc/mbart.html

Model · Translation

indictrans2-en-indic-dist-200M

AI4Bharat

This is the model card of IndicTrans2 En-Indic Distilled 200M variant. Please refer to section 7.6: Distilled Models in the TMLR submission for further details on model training, data and metrics. Please refer to the github repository for a detail description on how to use HF compatible IndicTrans2 models for inference. - New RoPE based IndicTrans2 models which are capable of handling sequence lengths upto 2048 tokens are available here - These models can be used by just changing the modelname parameter. Please read the model card of the RoPE-IT2 models for more information about the generation. - It is recommended to run these models with flashattention2 for efficient generation. If you…

Model · Translation

opus-mt-tc-big-en-bg

Helsinki-NLP Research Group

Neural machine translation model for translating from English (en) to Bulgarian (bg). This model is part of the OPUS-MT project, an effort to make neural machine translation models widely available and accessible for many languages in the world. All models are originally trained using the amazing framework of Marian NMT, an efficient NMT implementation written in pure C++. The models have been converted to pyTorch using the transformers library by huggingface. Training data is taken from OPUS and training pipelines use the procedures of OPUS-MT-train. You can also use OPUS-MT models with the transformers pipelines, for example: The work is supported by the European Language Grid as pilot…

Model · Translation

opus-mt-tc-big-tr-en

Helsinki-NLP Research Group

Neural machine translation model for translating from Turkish (tr) to English (en). This model is part of the OPUS-MT project, an effort to make neural machine translation models widely available and accessible for many languages in the world. All models are originally trained using the amazing framework of Marian NMT, an efficient NMT implementation written in pure C++. The models have been converted to pyTorch using the transformers library by huggingface. Training data is taken from OPUS and training pipelines use the procedures of OPUS-MT-train. You can also use OPUS-MT models with the transformers pipelines, for example: The work is supported by the European Language Grid as pilot…

Model · Translation

t5-base

T5 community

The developers of the Text-To-Text Transfer Transformer (T5) write: T5-Base is the checkpoint with 220 million parameters. The developers write in a blog post that the model: See the blog post and research paper for further details. The model is pre-trained on the Colossal Clean Crawled Corpus (C4), which was developed and released in the context of the same research paper as T5. The model was pre-trained on a on a multi-task mixture of unsupervised (1.) and supervised tasks (2.). Thereby, the following datasets were being used for (1.) and (2.): 1. Datasets used for Unsupervised denoising objective: 2. Datasets used for Supervised text-to-text language modeling objective - CoLA Warstadt et…