SAVRN
Search Contact SAVRN

Open-weight model · Token classification

distilbert-NER

by D dslim/distilbert-NER

If my open source models have been useful to you, please consider supporting me in building small, useful AI models for everyone (and help me afford med school / help out my parents financially). Thanks!

Parameters65M
Context512
Weights521.7 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads204.9k

Runs On

What it takes to serve distilbert-NER (65M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.1 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By D, published under apache-2.0, revision dfa2838a1273.

If my open source models have been useful to you, please consider supporting me in building small, useful AI models for everyone (and help me afford med school / help out my parents financially). Thanks!

Model description

distilbert-NER is the fine-tuned version of DistilBERT, which is a distilled variant of the BERT model. DistilBERT has fewer parameters than BERT, making it smaller, faster, and more efficient. distilbert-NER is specifically fine-tuned for the task of Named Entity Recognition (NER).

This model accurately identifies the same four types of entities as its BERT counterparts: location (LOC), organizations (ORG), person (PER), and Miscellaneous (MISC). Although it is a more compact model, distilbert-NER demonstrates a robust performance in NER tasks, balancing between size, speed, and accuracy.

The model was fine-tuned on the English version of the CoNLL-2003 Named Entity Recognition dataset, which is widely recognized for its comprehensive and diverse range of entity types.

Available NER models

Read the full model card (689 words)

Configuration

Architecture
DistilBertForTokenClassification
Context length (tokens)
512
Vocabulary size
28,996
Stored precision
float32
Model type
distilbert

Identity and Version

Repository
dslim/distilbert-NER
Publisher
D
Task
Token classification
Modality
Text
Library
transformers
Parameters
65M parameters
Languages
en
Revision
dfa2838a127384aabb82ed7719e16dab84c42a2a
First published
2024-01-25
Last updated
2024-10-08

Files and Weights

17 files, 523.5 MB in total. The weights are 3 files totalling 521.7 MB in bin, onnx, safetensors.

Weights3 files · 521.7 MB
Configuration4 files · 2.7 KB
Tokenizer6 files · 1.8 MB
Documentation1 file · 6.2 KB
Other2 files · 7.6 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights260.8 MB 235ecd699f65
onnx/model.onnxWeights260.9 MB 4440f9fc64cd
training_args.binWeights4.5 KB 2fea728bc126
config.jsonConfiguration926 B
onnx/config.jsonConfiguration925 B
onnx/special_tokens_map.jsonConfiguration695 B
special_tokens_map.jsonConfiguration125 B
README.mdDocumentation6.2 KB
runs/Jan25_20-44-33_2320f22f76d4/events.out.tfevents.1706215489.2320f22f76d4.240.0Other7.0 KB 2c1042dee9e6
runs/Jan25_20-44-33_2320f22f76d4/events.out.tfevents.1706216274.2320f22f76d4.240.1Other560 B 7cfcd444853c
.gitattributesRepository1.5 KB
onnx/tokenizer.jsonTokenizer669.0 KB
onnx/tokenizer_config.jsonTokenizer1.3 KB
onnx/vocab.txtTokenizer213.4 KB
tokenizer.jsonTokenizer669.0 KB
tokenizer_config.jsonTokenizer1.2 KB
vocab.txtTokenizer213.4 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
521.7 MB
Download from D

Released by D through its official repository on Hugging Face. Read the license.

Built From

  • Derived from distilbert/distilbert-base-cased
  • Described by arXiv:1810.04805
  • Described by arXiv:1910.01108
  • Quantized from distilbert/distilbert-base-cased
  • Trained on (disclosed) conll2003

Memory Requirements

PrecisionWeights in memory
As published521.7 MB
16-bit0.1 GB
8-bit0.1 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About distilbert-NER

How much GPU memory does distilbert-NER need?

About 0.2 GB at 16-bit and 0 GB at 4-bit: the weights (65M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run distilbert-NER on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use distilbert-NER commercially?

Yes. distilbert-NER is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is distilbert-NER's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Token classification

OpenMed-NER-BloodCancerDetect-TinyMed-65M

OpenMed

Specialized model for Clinical Entity Recognition - Clinical entities related to Chronic Lymphocytic Leukemia This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for clinical entity recognition - clinical entities related to chronic lymphocytic leukemia. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for…

Open weights apache-2.0 65M parameters 512 tokens transformers

Model · Token classification

biomedical-ner-all

D 4 Data Community

An English Named Entity Recognition model, trained on Maccrobat to recognize the bio-medical entities (107 entities) from a given text corpus (case reports etc.). This model was built on top of distilbert-base-uncased Checkout the tutorial video for explanation of this model and corresponding python library: https://youtu.be/xpiDPdBpS18 The easiest way is to load the inference api from huggingface and second method is through the pipeline object offered by transformers library. This model is part of the Research topic "AI in Biomedical field" conducted by Deepak John Reji, Shaina Raza. If you use this work (code, model or dataset), please star at

Open weights apache-2.0 66M parameters 512 tokens transformers

Model · Token classification

OpenMed-NER-OrganismDetect-TinyMed-82M

OpenMed

Specialized model for Species Entity Recognition - Species names from the Species-800 dataset This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for species entity recognition - species names from the species-800 dataset. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for clinical and research…

Open weights apache-2.0 82M parameters 514 tokens transformers

Model · Token classification

bert-small-pii-detection

Gravitee.io

Token-classification model for PII detection, fine-tuned from prajjwal1/bert-small on Detect personally identifiable information (PII) spans in english text. Suitable for privacy filtering, redaction pipelines, and data-leak prevention particularly on structured data (JSON, HTML, XML, SQL, Document) English-focused; other languages will degrade External-corpus evaluation (English only), seqeval. Last run: 2026-05-21. Data citation are present in the dataset card used for this model. If you use the model, please consider citing the papers

Open weights apache-2.0 29M parameters 512 tokens

Model · Token classification

OpenMed-NER-OrganismDetect-BioPatient-108M

OpenMed

Specialized model for Species Entity Recognition - Species names from the Species-800 dataset This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for species entity recognition - species names from the species-800 dataset. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for clinical and research…

Open weights apache-2.0 108M parameters 512 tokens transformers

Model · Token classification

bert-base-NER

D

If my open source models have been useful to you, please consider supporting me in building small, useful AI models for everyone (and help me afford med school / help out my parents financially). Thanks! bert-base-NER is a fine-tuned BERT model that is ready to use for Named Entity Recognition and achieves state-of-the-art performance for the NER task. It has been trained to recognize four types of entities: location (LOC), organizations (ORG), person (PER) and Miscellaneous (MISC). Specifically, this model is a bert-base-cased model that was fine-tuned on the English version of the standard CoNLL-2003 Named Entity Recognition dataset. If you'd like to use a larger BERT-large model…

Open weights mit 108M parameters 512 tokens transformers