SAVRN Model Hub · Comparisons
bert-large-uncased vs roberta-large
Bert-large-uncased has 336M parameters and roberta-large has 355M parameters; bert-large-uncased is released under Apache License 2.0 and roberta-large under MIT License; at 16-bit, bert-large-uncased needs about 0.8 GB (1x MI300X from $1.85 an hour) and roberta-large about 0.9 GB (1x MI300X from $1.85 an hour).
| Field | bert-large-uncased google-bert/bert-large-uncased | roberta-large FacebookAI/roberta-large |
|---|---|---|
| Publisher | BERT community | Facebook AI community |
| Task | Fill mask | Fill mask |
| Modality | Text | Text |
| Parameters, as reported | 336M parameters | 355M parameters |
| Architecture | BertForMaskedLM | RobertaForMaskedLM |
| Library | transformers | transformers |
| Context length | 512 tokens | 514 tokens |
| Repository size | 8.2 GB | 7.5 GB |
| Artifact formats | safetensors, pytorch, jax, rust, tf | safetensors, onnx, pytorch, jax, tf |
| License | apache-2.0 | mit |
| Access | Open weights, no gate | Open weights, no gate |
| Memory at 16-bit (weights and margin) | 0.8 GB | 0.9 GB |
| Cheapest GPUs at 16-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Memory at 4-bit (weights and margin) | 0.2 GB | 0.2 GB |
| Cheapest GPUs at 4-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Revision viewed | 6da4b6a26a18 | 722cf37b1afa |
| Downloads reported by the hub | 1M | 6.5M |
| Last observed | 2026-09-18 | 2026-09-18 |
An evaluation row appears only where at least two of these models report the same benchmark with the same stated configuration, metric, unit and setup. Different evaluators stay named in each cell. Values are shown as reported: no unit conversion, no ranking.
Questions
Which is larger, bert-large-uncased or roberta-large?
roberta-large (355M parameters) is larger than bert-large-uncased (336M parameters), by the parameter counts their publishers report.
Which is cheaper to run, bert-large-uncased or roberta-large?
At 4-bit, bert-large-uncased fits on 1x MI300X from $1.85 an hour and roberta-large on 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use bert-large-uncased commercially?
Yes. bert-large-uncased is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
Can I use roberta-large commercially?
Yes. roberta-large is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.