SAVRN Model Hub · Comparisons
roberta-large vs xlm-roberta-base
Roberta-large has 355M parameters and xlm-roberta-base has 279M parameters; both are released under MIT License; at 16-bit, roberta-large needs about 0.9 GB (1x MI300X from $1.85 an hour) and xlm-roberta-base about 0.7 GB (1x MI300X from $1.85 an hour).
| Field | roberta-large FacebookAI/roberta-large | xlm-roberta-base FacebookAI/xlm-roberta-base |
|---|---|---|
| Publisher | Facebook AI community | Facebook AI community |
| Task | Fill mask | Fill mask |
| Modality | Text | Text |
| Parameters, as reported | 355M parameters | 279M parameters |
| Architecture | RobertaForMaskedLM | XLMRobertaForMaskedLM |
| Library | transformers | transformers |
| Context length | 514 tokens | 514 tokens |
| Repository size | 7.5 GB | 6.4 GB |
| Artifact formats | safetensors, onnx, pytorch, jax, tf | safetensors, onnx, pytorch, jax, tf |
| License | mit | mit |
| Access | Open weights, no gate | Open weights, no gate |
| Memory at 16-bit (weights and margin) | 0.9 GB | 0.7 GB |
| Cheapest GPUs at 16-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Memory at 4-bit (weights and margin) | 0.2 GB | 0.2 GB |
| Cheapest GPUs at 4-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Revision viewed | 722cf37b1afa | e73636d4f797 |
| Downloads reported by the hub | 6.5M | 21.5M |
| Last observed | 2026-09-18 | 2026-09-18 |
An evaluation row appears only where at least two of these models report the same benchmark with the same stated configuration, metric, unit and setup. Different evaluators stay named in each cell. Values are shown as reported: no unit conversion, no ranking.
Questions
Which is larger, roberta-large or xlm-roberta-base?
roberta-large (355M parameters) is larger than xlm-roberta-base (279M parameters), by the parameter counts their publishers report.
Which is cheaper to run, roberta-large or xlm-roberta-base?
At 4-bit, roberta-large fits on 1x MI300X from $1.85 an hour and xlm-roberta-base on 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use roberta-large commercially?
Yes. roberta-large is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.
Can I use xlm-roberta-base commercially?
Yes. xlm-roberta-base is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.