Neural machine translation model for translating from English (en) to Bulgarian (bg). This model is part of the OPUS-MT project, an effort to make neural machine translation models widely available and accessible for many languages in the world. All models are originally trained using the amazing framework of Marian NMT, an efficient NMT implementation written in pure C++. The models have been converted to pyTorch using the transformers library by huggingface. Training data is taken from OPUS and training pipelines use the procedures of OPUS-MT-train. You can also use OPUS-MT models with the transformers pipelines, for example: The work is supported by the European Language Grid as pilot…
Open weights
cc-by-4.0
238M parameters
1,024 tokens
transformers
The developers of the Text-To-Text Transfer Transformer (T5) write: T5-Base is the checkpoint with 220 million parameters. The developers write in a blog post that the model: See the blog post and research paper for further details. The model is pre-trained on the Colossal Clean Crawled Corpus (C4), which was developed and released in the context of the same research paper as T5. The model was pre-trained on a on a multi-task mixture of unsupervised (1.) and supervised tasks (2.). Thereby, the following datasets were being used for (1.) and (2.): 1. Datasets used for Unsupervised denoising objective: 2. Datasets used for Supervised text-to-text language modeling objective - CoLA Warstadt et…
Open weights
apache-2.0
223M parameters
transformers
Neural machine translation model for translating from Korean (ko) to English (en). This model is part of the OPUS-MT project, an effort to make neural machine translation models widely available and accessible for many languages in the world. All models are originally trained using the amazing framework of Marian NMT, an efficient NMT implementation written in pure C++. The models have been converted to pyTorch using the transformers library by huggingface. Training data is taken from OPUS and training pipelines use the procedures of OPUS-MT-train. - More information about released models for this language pair: OPUS-MT kor-eng README - Tatoeba Translation…
Open weights
cc-by-4.0
209M parameters
1,024 tokens
transformers
This is the model card of IndicTrans2 En-Indic Distilled 200M variant. Please refer to section 7.6: Distilled Models in the TMLR submission for further details on model training, data and metrics. Please refer to the github repository for a detail description on how to use HF compatible IndicTrans2 models for inference. - New RoPE based IndicTrans2 models which are capable of handling sequence lengths upto 2048 tokens are available here - These models can be used by just changing the modelname parameter. Please read the model card of the RoPE-IT2 models for more information about the generation. - It is recommended to run these models with flashattention2 for efficient generation. If you…
Access requested at publisher
mit
275M parameters
transformers
source languages: fr; target languages: en; OPUS readme: fr-en; dataset: opus; model: transformer-align; pre-processing: normalization + SentencePiece.
Open weights
apache-2.0
75M parameters
512 tokens
transformers
The developers of the Text-To-Text Transfer Transformer (T5) write: T5-Small is the checkpoint with 60 million parameters. The developers write in a blog post that the model: See the blog post and research paper for further details. The model is pre-trained on the Colossal Clean Crawled Corpus (C4), which was developed and released in the context of the same research paper as T5. The model was pre-trained on a on a multi-task mixture of unsupervised (1.) and supervised tasks (2.). Thereby, the following datasets were being used for (1.) and (2.): 1. Datasets used for Unsupervised denoising objective: 2. Datasets used for Supervised text-to-text language modeling objective - CoLA Warstadt et…
Open weights
apache-2.0
61M parameters
transformers
