This model is a conversion of MoritzLaurer/roberta-base-zeroshot-v2.0-c to ONNX format using the Optimum library.
Open-weight model · Zero-shot classification
mDeBERTa-v3-base-xnli-multilingual-nli-2mil7
by Joshua Xenova/mDeBERTa-v3-base-xnli-multilingual-nli-2mil7
https://huggingface.co/MoritzLaurer/mDeBERTa-v3-base-xnli-multilingual-nli-2mil7 with ONNX weights to be compatible with Transformers.js.
Parameters—
Context512
Weights4.8 GB
License—
AccessOpen weights
Monthly Downloads3.5k
Model Card
https://huggingface.co/MoritzLaurer/mDeBERTa-v3-base-xnli-multilingual-nli-2mil7 with ONNX weights to be compatible with Transformers.js. If you haven't already, you can install the Transformers.js JavaScript library from NPM using: Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).
Excerpt from the card by Joshua.
Configuration
- Architecture
- DebertaV2ForSequenceClassification
- Context length (tokens)
- 512
- Layers
- 12
- Hidden size
- 768
- Feed-forward size
- 3,072
- Attention heads
- 12
- Vocabulary size
- 251,000
- Model type
- deberta-v2
Identity and Version
- Repository
- Xenova/mDeBERTa-v3-base-xnli-multilingual-nli-2mil7
- Publisher
- Joshua
- Task
- Zero-shot classification
- Modality
- Text
- Library
- transformers.js
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 0864ced79bf1ef851bfaf9dd9de0aa54d735d9d0
- First published
- 2023-08-08
- Last updated
- 2025-07-11
Files and Weights
17 files, 4.8 GB in total. The weights are 8 files totalling 4.8 GB in onnx.
Weights8 files · 4.8 GB
Configuration4 files · 2.5 KB
Tokenizer2 files · 16.3 MB
Documentation1 file · 1.2 KB
Other1 file · 4.3 MB
Repository1 file · 1.6 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| onnx/model.onnx | Weights | 1.1 GB | 425210a8a917 |
| onnx/model_bnb4.onnx | Weights | 860.1 MB | 563d1b9298ce |
| onnx/model_fp16.onnx | Weights | 558.8 MB | a8aa1307f511 |
| onnx/model_int8.onnx | Weights | 317.3 MB | 0e00534691ca |
| onnx/model_q4.onnx | Weights | 865.4 MB | ece72d29def4 |
| onnx/model_q4f16.onnx | Weights | 454.2 MB | c3c2f5e098fa |
| onnx/model_quantized.onnx | Weights | 338.7 MB | ccb655bf617e |
| onnx/model_uint8.onnx | Weights | 317.3 MB | 953cc072cd11 |
| added_tokens.json | Configuration | 23 B | — |
| config.json | Configuration | 1.1 KB | — |
| quantize_config.json | Configuration | 1.2 KB | — |
| special_tokens_map.json | Configuration | 173 B | — |
| README.md | Documentation | 1.2 KB | — |
| spm.model | Other | 4.3 MB | 13c8d666d62a |
| .gitattributes | Repository | 1.6 KB | — |
| tokenizer.json | Tokenizer | 16.3 MB | e23095eb61ba |
| tokenizer_config.json | Tokenizer | 492 B | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 4.8 GB
Download from Joshua
Released by Joshua through its official repository on Hugging Face.
Built From
- Derived from MoritzLaurer/mDeBERTa-v3-base-xnli-multilingual-nli-2mil7
- Quantized from MoritzLaurer/mDeBERTa-v3-base-xnli-multilingual-nli-2mil7
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 4.8 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About mDeBERTa-v3-base-xnli-multilingual-nli-2mil7
What is mDeBERTa-v3-base-xnli-multilingual-nli-2mil7's context length?
512 tokens, from the maximum position embeddings in its published configuration.
Similar Models
https://huggingface.co/facebook/bart-large-mnli with ONNX weights to be compatible with Transformers.js. If you haven't already, you can install the Transformers.js JavaScript library from NPM using: Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).
distilbart-mnli is the distilled version of bart-large-mnli created using the No Teacher Distillation technique proposed for BART summarisation by Huggingface, here. We just copy alternating layers from bart-large-mnli and finetune more on the same data. This is a very simple and effective technique, as we can see the performance drop is very little. Detailed performace trade-offs will be posted in this sheet. If you want to train these models yourself, clone the distillbart-mnli repo and follow the steps below Clone and install transformers from source Download MNLI data Create student model Start fine-tuning You can find the logs of these trained models in this wandb project.
distilbart-mnli is the distilled version of bart-large-mnli created using the No Teacher Distillation technique proposed for BART summarisation by Huggingface, here. We just copy alternating layers from bart-large-mnli and finetune more on the same data. This is a very simple and effective technique, as we can see the performance drop is very little. Detailed performace trade-offs will be posted in this sheet. If you want to train these models yourself, clone the distillbart-mnli repo and follow the steps below Clone and install transformers from source Download MNLI data Create student model Start fine-tuning You can find the logs of these trained models in this wandb project.
https://huggingface.co/typeform/mobilebert-uncased-mnli with ONNX weights to be compatible with Transformers.js. If you haven't already, you can install the Transformers.js JavaScript library from NPM using: Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).
https://huggingface.co/cross-encoder/nli-deberta-v3-xsmall with ONNX weights to be compatible with Transformers.js. If you haven't already, you can install the Transformers.js JavaScript library from NPM using: Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).