SAVRN Model Hub · Comparisons
distilbert-base-multilingual-cased vs ModernBERT-base
Distilbert-base-multilingual-cased has 135M parameters and ModernBERT-base has 150M parameters; both are released under Apache License 2.0; at 16-bit, distilbert-base-multilingual-cased needs about 0.3 GB (1x MI300X from $1.85 an hour) and ModernBERT-base about 0.4 GB (1x MI300X from $1.85 an hour).
| Field | distilbert-base-multilingual-cased distilbert/distilbert-base-multilingual-cased | ModernBERT-base answerdotai/ModernBERT-base |
|---|---|---|
| Publisher | DistilBERT community | Answer.AI |
| Task | Fill mask | Fill mask |
| Modality | Text | Text |
| Parameters, as reported | 135M parameters | 150M parameters |
| Architecture | DistilBertForMaskedLM | ModernBertForMaskedLM |
| Library | transformers | transformers |
| Context length | 512 tokens | 8,192 tokens |
| Repository size | 2.9 GB | 3.1 GB |
| Artifact formats | safetensors, onnx, pytorch, tf | safetensors, onnx, pytorch |
| License | apache-2.0 | apache-2.0 |
| Access | Open weights, no gate | Open weights, no gate |
| Memory at 16-bit (weights and margin) | 0.3 GB | 0.4 GB |
| Cheapest GPUs at 16-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Memory at 4-bit (weights and margin) | 0.1 GB | 0.1 GB |
| Cheapest GPUs at 4-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Revision viewed | 45c032ab32cc | 8949b909ec90 |
| Downloads reported by the hub | 541.6k | 4.5M |
| Last observed | 2026-09-18 | 2026-09-18 |
An evaluation row appears only where at least two of these models report the same benchmark with the same stated configuration, metric, unit and setup. Different evaluators stay named in each cell. Values are shown as reported: no unit conversion, no ranking.
Questions
Which is larger, distilbert-base-multilingual-cased or ModernBERT-base?
ModernBERT-base (150M parameters) is larger than distilbert-base-multilingual-cased (135M parameters), by the parameter counts their publishers report.
Which is cheaper to run, distilbert-base-multilingual-cased or ModernBERT-base?
At 4-bit, distilbert-base-multilingual-cased fits on 1x MI300X from $1.85 an hour and ModernBERT-base on 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use distilbert-base-multilingual-cased commercially?
Yes. distilbert-base-multilingual-cased is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
Can I use ModernBERT-base commercially?
Yes. ModernBERT-base is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.