SAVRN
Search Contact SAVRN

Open-weight model · Token classification

llmlingua-2-xlm-roberta-large-meetingbank

by Microsoft microsoft/llmlingua-2-xlm-roberta-large-meetingbank

This model was introduced in the paper LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression (Pan et al, 2024).

Parameters559M
Context514
Weights2.2 GB
Licensemit
AccessOpen weights
Monthly Downloads187.1k

Runs On

What it takes to serve llmlingua-2-xlm-roberta-large-meetingbank (559M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 1.1 GB 1.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.6 GB 0.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.3 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By Microsoft, published under mit, revision ebaba9b0e874.

LLMLingua-2-Bert-base-Multilingual-Cased-MeetingBank

This model was introduced in the paper LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression (Pan et al, 2024). It is a XLM-RoBERTa (large-sized model) finetuned to perform token classification for task agnostic prompt compression. The probability $p_{preserve}$ of each token $x_i$ is used as the metric for compression. This model is trained on the extractive text compression dataset constructed with the methodology proposed in the LLMLingua-2, using training examples from MeetingBank (Hu et al, 2023) as the seed data.

You can evaluate the model on downstream tasks such as question answering (QA) and summarization over compressed meeting transcripts using this dataset.

For more details, please check the home page of LLMLingua-2 and LLMLingua Series.

Usage

Read the full model card (358 words)

Configuration

Architecture
XLMRobertaForTokenClassification
Context length (tokens)
514
Layers
24
Hidden size
1,024
Feed-forward size
4,096
Attention heads
16
Vocabulary size
250,102
Stored precision
float32
Model type
xlm-roberta

Identity and Version

Repository
microsoft/llmlingua-2-xlm-roberta-large-meetingbank
Publisher
Microsoft
Task
Token classification
Modality
Text
Library
transformers
Parameters
559M parameters
Languages
xlm-roberta
Revision
ebaba9b0e874dadd3003ffcff828e4397e568089
First published
2024-03-17
Last updated
2025-01-08

Files and Weights

7 files, 2.3 GB in total. The weights are 1 file totalling 2.2 GB in safetensors.

Weights1 file · 2.2 GB
Configuration2 files · 1.0 KB
Tokenizer2 files · 17.1 MB
Documentation1 file · 3.3 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights2.2 GB a33a153b2493
config.jsonConfiguration752 B
special_tokens_map.jsonConfiguration280 B
README.mdDocumentation3.3 KB
.gitattributesRepository1.6 KB
tokenizer.jsonTokenizer17.1 MB f59925fcb90c
tokenizer_config.jsonTokenizer1.1 KB

License and Download

License
mit
Access
Open weights, no gate
Download size
2.2 GB
Download from Microsoft

Released by Microsoft through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published2.2 GB
16-bit1.1 GB
8-bit0.6 GB
4-bit0.3 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About llmlingua-2-xlm-roberta-large-meetingbank

How much GPU memory does llmlingua-2-xlm-roberta-large-meetingbank need?

About 1.3 GB at 16-bit and 0.3 GB at 4-bit: the weights (559M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run llmlingua-2-xlm-roberta-large-meetingbank on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use llmlingua-2-xlm-roberta-large-meetingbank commercially?

Yes. llmlingua-2-xlm-roberta-large-meetingbank is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

What is llmlingua-2-xlm-roberta-large-meetingbank's context length?

514 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Token classification

fullstop-punctuation-multilang-large

Oliver Guhr

This model predicts the punctuation of English, Italian, French and German texts. We developed it to restore the punctuation of transcribed spoken language. This multilanguage model was trained on the Europarl Dataset provided by the SEPP-NLG Shared Task. Please note that this dataset consists of political speeches. Therefore the model might perform differently on texts from other domains. The model restores the following punctuation markers: "." "," "?" "-" ":" We provide a simple python package that allows you to process text of any length. To get started install the package from pypi: output output The performance differs for the single punctuation markers as hyphens and colons, in many…

Open weights mit 559M parameters 514 tokens transformers

Model · Token classification

OpenMed-NER-GenomicDetect-BigMed-560M

OpenMed

Specialized model for Gene Entity Recognition - Gene-related entities This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for gene entity recognition - gene-related entities. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for clinical and research applications. This model can identify and classify the…

Open weights apache-2.0 559M parameters 514 tokens transformers

Model · Token classification

OpenMed-NER-ChemicalDetect-BigMed-560M

OpenMed

Specialized model for Chemical Entity Recognition - Identifies chemical compounds and substances in biomedical literature This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for chemical entity recognition - identifies chemical compounds and substances in biomedical literature. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with…

Open weights apache-2.0 559M parameters 514 tokens transformers

Specialized model for Clinical Entity Recognition - Clinical entities related to Chronic Lymphocytic Leukemia This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for clinical entity recognition - clinical entities related to chronic lymphocytic leukemia. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for…

Open weights apache-2.0 559M parameters 514 tokens transformers

Model · Token classification

OpenMed-NER-ChemicalDetect-MultiMed-568M

OpenMed

Specialized model for Chemical Entity Recognition - Identifies chemical compounds and substances in biomedical literature This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for chemical entity recognition - identifies chemical compounds and substances in biomedical literature. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with…

Open weights apache-2.0 567M parameters 8,194 tokens transformers

Model · Token classification

OpenMed-NER-OncologyDetect-MultiMed-568M

OpenMed

Specialized model for Cancer Genetics - Cancer-related genetic entities This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for cancer genetics - cancer-related genetic entities. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for clinical and research applications. This model can identify and classify the…

Open weights apache-2.0 567M parameters 8,194 tokens transformers