privacy-filter-multilingual

Model · Token classification

privacy-filter

OpenAI

OpenAI Privacy Filter is a bidirectional token-classification model for personally identifiable information (PII) detection and masking in text. It is intended for high-throughput data sanitization workflows where teams need a model that they can run on-premises that is fast, context-aware, and tunable. OpenAI Privacy Filter is pretrained autoregressively to arrive at a checkpoint with similar architecture to gpt-oss, albeit of a smaller size. We then converted that checkpoint into a bidirectional token classifier over a privacy label taxonomy, and post-trained with a supervised classification loss. (For architecture details about gpt-oss, please see the gpt-oss model card.) Instead of…

Model · Token classification

OpenMed-NER-OncologyDetect-MultiMed-568M

OpenMed

Specialized model for Cancer Genetics - Cancer-related genetic entities This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for cancer genetics - cancer-related genetic entities. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for clinical and research applications. This model can identify and classify the…

Model · Token classification

OpenMed-NER-ChemicalDetect-MultiMed-568M

OpenMed

Specialized model for Chemical Entity Recognition - Identifies chemical compounds and substances in biomedical literature This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for chemical entity recognition - identifies chemical compounds and substances in biomedical literature. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with…

Model · Token classification

llmlingua-2-xlm-roberta-large-meetingbank

Microsoft

This model was introduced in the paper LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression (Pan et al, 2024). It is a XLM-RoBERTa (large-sized model) finetuned to perform token classification for task agnostic prompt compression. The probability $p{preserve}$ of each token $xi$ is used as the metric for compression. This model is trained on the extractive text compression dataset constructed with the methodology proposed in the LLMLingua-2, using training examples from MeetingBank (Hu et al, 2023) as the seed data. You can evaluate the model on downstream tasks such as question answering (QA) and summarization over compressed meeting transcripts using…

Model · Token classification

fullstop-punctuation-multilang-large

Oliver Guhr

This model predicts the punctuation of English, Italian, French and German texts. We developed it to restore the punctuation of transcribed spoken language. This multilanguage model was trained on the Europarl Dataset provided by the SEPP-NLG Shared Task. Please note that this dataset consists of political speeches. Therefore the model might perform differently on texts from other domains. The model restores the following punctuation markers: "." "," "?" "-" ":" We provide a simple python package that allows you to process text of any length. To get started install the package from pypi: output output The performance differs for the single punctuation markers as hyphens and colons, in many…

Model · Token classification

OpenMed-NER-GenomicDetect-BigMed-560M

OpenMed

Specialized model for Gene Entity Recognition - Gene-related entities This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for gene entity recognition - gene-related entities. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for clinical and research applications. This model can identify and classify the…