SAVRN
Search Contact SAVRN

Open-weight model · Text classification

bert-base-multilingual-uncased-sentiment

by NLP Town nlptown/bert-base-multilingual-uncased-sentiment

Visit the NLP Town website for an updated version of this model, with a 40% error reduction on product reviews.

Parameters167M
Context512
Weights2.7 GB
Licensemit
AccessOpen weights
Monthly Downloads733.6k

Runs On

What it takes to serve bert-base-multilingual-uncased-sentiment (167M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.3 GB 0.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.2 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on bert-base-multilingual-uncased-sentiment

Product reviews go in, star ratings come out. This 167 million parameter BERT classifier from NLP Town reads a review in English, Dutch, German, French, Spanish or Italian and returns 1 to 5 stars. At 16-bit the weights are 0.3 GB and the run needs 0.4 GB, so fit is never the question. The cheapest listed setup, one MI300X with 192 GB at $1.85 an hour on demand, would sit almost entirely idle; put this on a card that already has other work.

MIT permits commercial use, modification and redistribution as long as the notices travel with it. Two checks before you commit: context is 512 tokens, so long reviews get truncated, and the publisher points to a newer version on its own site with a 40 percent error reduction on product reviews, so this copy, released March 2022, is not the newest one.

Model Card

By NLP Town, published under mit, revision 8f6f4e3a8f70.

Visit the NLP Town website for an updated version of this model, with a 40% error reduction on product reviews.

This is a bert-base-multilingual-uncased model finetuned for sentiment analysis on product reviews in six languages: English, Dutch, German, French, Spanish, and Italian. It predicts the sentiment of the review as a number of stars (between 1 and 5).

This model is intended for direct use as a sentiment analysis model for product reviews in any of the six languages above or for further finetuning on related sentiment analysis tasks.

Training data

Here is the number of product reviews we used for finetuning the model:

Language Number of reviews
English 150k
Dutch 80k
German 137k
French 140k
Italian 72k
Spanish 50k

Accuracy

The fine-tuned model obtained the following accuracy on 5,000 held-out product reviews in each of the languages:

Read the full model card (244 words)

Configuration

Architecture
BertForSequenceClassification
Context length (tokens)
512
Layers
12
Hidden size
768
Feed-forward size
3,072
Attention heads
12
Vocabulary size
105,879
Model type
bert

Identity and Version

Repository
nlptown/bert-base-multilingual-uncased-sentiment
Publisher
NLP Town
Task
Text classification
Modality
Text
Library
transformers
Parameters
167M parameters
Languages
en, nl, de, fr, it, es
Revision
8f6f4e3a8f70be4b65d3a4a8762b6d781cda240d
First published
2022-03-02
Last updated
2025-01-02

Files and Weights

10 files, 2.7 GB in total. The weights are 4 files totalling 2.7 GB in bin, h5, msgpack, safetensors.

Weights4 files · 2.7 GB
Configuration2 files · 1.1 KB
Tokenizer2 files · 871.9 KB
Documentation1 file · 2.0 KB
Repository1 file · 445 B
Every file
FileTypeSizeSHA-256
flax_model.msgpackWeights669.4 MB 7988c7c36108
model.safetensorsWeights669.5 MB 0435c6c12c80
pytorch_model.binWeights669.5 MB e72c9084bf53
tf_model.h5Weights669.7 MB cb7ef0d2a487
config.jsonConfiguration953 B
special_tokens_map.jsonConfiguration112 B
README.mdDocumentation2.0 KB
.gitattributesRepository445 B
tokenizer_config.jsonTokenizer39 B
vocab.txtTokenizer871.9 KB

License and Download

License
mit
Access
Open weights, no gate
Download size
2.7 GB
Download from NLP Town

Released by NLP Town through its official repository on Hugging Face. Read the license.

Memory Requirements

PrecisionWeights in memory
As published2.7 GB
16-bit0.3 GB
8-bit0.2 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About bert-base-multilingual-uncased-sentiment

How much GPU memory does bert-base-multilingual-uncased-sentiment need?

About 0.4 GB at 16-bit and 0.1 GB at 4-bit: the weights (167M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run bert-base-multilingual-uncased-sentiment on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use bert-base-multilingual-uncased-sentiment commercially?

Yes. bert-base-multilingual-uncased-sentiment is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

What is bert-base-multilingual-uncased-sentiment's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text classification

deberta-v3-base-prompt-injection-v2

Protect AI

This model is a fine-tuned version of microsoft/deberta-v3-base specifically developed to detect and classify prompt injection attacks which can manipulate language models into producing unintended outputs. Prompt injection attacks manipulate language models by inserting or altering prompts to trigger harmful or unintended responses. The deberta-v3-base-prompt-injection-v2 model is designed to enhance security in language model applications by detecting these malicious interventions. This model classifies inputs into benign (0) and injection-detected (1). deberta-v3-base-prompt-injection-v2 is highly accurate in identifying prompt injections in English. It does not detect jailbreak attacks…

Open weights apache-2.0 184M parameters 512 tokens transformers

This model was trained on 1.279.665 hypothesis-premise pairs from 8 NLI datasets: MultiNLI, Fever-NLI, LingNLI and DocNLI (which includes ANLI, QNLI, DUC, CNN/DailyMail, Curation). It is the only model in the model hub trained on 8 NLI datasets, including DocNLI with very long texts to learn long range reasoning. Note that the model was trained on binary NLI to predict either "entailment" or "not-entailment". The DocNLI merges the classes "neural" and "contradiction" into "not-entailment" to enable the inclusion of the DocNLI dataset. The base model is DeBERTa-v3-base from Microsoft. The v3 variant of DeBERTa substantially outperforms previous versions of the model by including a different…

Open weights mit 184M parameters 512 tokens transformers

Model · Text classification

Firebird-ModernBERT-512-RW

Noumenon, Inc.

Firebird-ModernBERT-512-RW is an experimental post-trained variant of It is a ~149M parameter ModernBERT binary classifier for distinguishing: - 0 — HUMAN The maximum sequence length is 512 tokens. This checkpoint was produced through reward-weighted classifier post-training. The original Firebird checkpoint was kept frozen as a reference model. Training examples were scored by the original classifier, difficult examples received larger loss weights, and the post-trained model was constrained against the frozen reference using a KL penalty. L = weightedcrossentropy + beta KL(reference || policy) Hard human examples received greater weighting than ordinary examples because one goal of the…

Open weights 150M parameters 8,192 tokens transformers

This model is distilled from the zero-shot classification pipeline on the Multilingual Sentiment dataset using this script. In reality the multilingual-sentiment dataset is annotated of course, but we'll pretend and ignore the annotations for the sake of example. Result can be reproduce using the following commands: If you are training this model on Colab, make the following code changes to avoid Out-of-memory error message: - Transformers 4.28.1 - Pytorch 2.0.0+cu118 - Datasets 2.11.0 - Tokenizers 0.13.3

Open weights apache-2.0 135M parameters 512 tokens transformers

Model · Text classification

turn-detector

LiveKit

An open-weights language model for contextually-aware end-of-utterance (EOU) detection in voice AI applications. The model predicts whether a user has finished speaking based on the semantic content of their transcribed speech, providing a critical complement to voice activity detection (VAD) systems. Traditional voice agents rely on voice activity detection (VAD) to determine when a user has finished speaking. VAD works by detecting the presence or absence of speech in an audio signal and applying a silence timer. While effective for detecting pauses, VAD lacks language understanding and frequently causes false positives. For example, a user who says "I need to think about that for a…

Open weights other 135M parameters 8,192 tokens transformers

Model · Text classification

roberta-base-go_emotions

Sam Lowe

Model trained from roberta-base on the goemotions dataset for multi-label classification. A version of this model in ONNX format (including an INT8 quantized ONNX version) is now available at https://huggingface.co/SamLowe/roberta-base-goemotions-onnx. These are faster for inference, esp for smaller batch sizes, massively reduce the size of the dependencies required for inference, make inference of the model more multi-platform, and in the case of the quantized version reduce the model file/download size by 75% whilst retaining almost all the accuracy if you only need inference. goemotions is based on Reddit data and has 28 labels. It is a multi-label dataset where one or multiple labels…

Open weights mit 125M parameters 514 tokens transformers