SAVRN Model Hub · Comparisons
bert-base-cased vs camembert-base
Bert-base-cased has 109M parameters and camembert-base has 111M parameters; bert-base-cased is released under Apache License 2.0 and camembert-base under MIT License; at 16-bit, bert-base-cased needs about 0.3 GB (1x MI300X from $1.85 an hour) and camembert-base about 0.3 GB (1x MI300X from $1.85 an hour).
| Field | bert-base-cased google-bert/bert-base-cased | camembert-base almanach/camembert-base |
|---|---|---|
| Publisher | BERT community | ALMAnaCH (Inria) |
| Task | Fill mask | Fill mask |
| Modality | Text | Text |
| Parameters, as reported | 109M parameters | 111M parameters |
| Architecture | BertForMaskedLM | CamembertForMaskedLM |
| Library | transformers | transformers |
| Context length | 512 tokens | 514 tokens |
| Repository size | 1.8 GB | 1.4 GB |
| Artifact formats | safetensors, pytorch, jax, tf | safetensors, pytorch, tf |
| License | apache-2.0 | mit |
| Access | Open weights, no gate | Open weights, no gate |
| Memory at 16-bit (weights and margin) | 0.3 GB | 0.3 GB |
| Cheapest GPUs at 16-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Memory at 4-bit (weights and margin) | 0.1 GB | 0.1 GB |
| Cheapest GPUs at 4-bit, per hour | 1x MI300X, $1.85 | 1x MI300X, $1.85 |
| Revision viewed | cd5ef92a9fb2 | a75967561c78 |
| Downloads reported by the hub | 3.5M | 997.2k |
| Last observed | 2026-10-13 | 2026-10-13 |
An evaluation row appears only where at least two of these models report the same benchmark with the same stated configuration, metric, unit and setup. Different evaluators stay named in each cell. Values are shown as reported: no unit conversion, no ranking.
SAVRN's Notes on bert-base-cased
Nobody needs to size a server around 109 million parameters, and the memory line says why: at 16-bit the weights come to 0.2 GB and the model runs in 0.3 GB. The cheapest Index setup, one MI300X with 192 GB at $1.85 an hour on-demand, is the smallest slice we list, not what it asks for. Run it on what you own; it fills masked tokens in English text inside a 512 token window, and capitalization changes its answer.
Apache 2.0 lets you ship it in a commercial product if the license and notice files travel with it and you state significant changes. Check that 512 tokens covers your inputs, that bookcorpus and wikipedia pretraining fits your domain, and that a 2024-02-19 last update is recent enough. The repository runs to 1.8 GB across ten files, holding safetensors, pytorch, jax and tf, so pull the format your stack loads.
SAVRN's Notes on camembert-base
French is the reason to choose camembert-base over the other fill-mask models here. ALMAnaCH at Inria built it on the RoBERTa design with 111M parameters, a 514-token context and a 32,005-entry vocabulary, pretrained on the oscar corpus. At 16-bit the weights take 0.2 GB and the run needs 0.3 GB; 8-bit or 4-bit gets both to 0.1 GB. The cheapest setup we price, one MI300X with 192 GB at $1.85 an hour on-demand, leaves nearly all of that card free.
MIT is as light as a license gets: commercial use, modification and redistribution, provided the copyright and permission notices ride along. The publisher offers six versions with different parameter counts and pretraining data, so confirm this base variant is the one your pipeline validated. The download runs 1.43 GB across nine files, well above the 0.2 GB of 16-bit weights, so budget disk for it.
Questions
Which is larger, bert-base-cased or camembert-base?
camembert-base (111M parameters) is larger than bert-base-cased (109M parameters), by the parameter counts their publishers report.
Which is cheaper to run, bert-base-cased or camembert-base?
At 4-bit, bert-base-cased fits on 1x MI300X from $1.85 an hour and camembert-base on 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use bert-base-cased commercially?
Yes. bert-base-cased is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
Can I use camembert-base commercially?
Yes. camembert-base is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.