If my open source models have been useful to you, please consider supporting me in building small, useful AI models for everyone (and help me afford med school / help out my parents financially). Thanks! distilbert-NER is the fine-tuned version of DistilBERT, which is a distilled variant of the BERT model. DistilBERT has fewer parameters than BERT, making it smaller, faster, and more efficient. distilbert-NER is specifically fine-tuned for the task of Named Entity Recognition (NER). This model accurately identifies the same four types of entities as its BERT counterparts: location (LOC), organizations (ORG), person (PER), and Miscellaneous (MISC). Although it is a more compact model…
Open-weight model · Token classification
OpenMed-NER-BloodCancerDetect-TinyMed-65M
by OpenMed OpenMed/OpenMed-NER-BloodCancerDetect-TinyMed-65M
OpenMed-NER-BloodCancerDetect-TinyMed-65M is an open-weight model for token classification from OpenMed, released under Apache License 2.0. It has 65M parameters and a 512-token context. At 16-bit it needs about 0.2 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 224.3k downloads a month.
Specialized model for Clinical Entity Recognition - Clinical entities related to Chronic Lymphocytic Leukemia This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for clinical entity recognition - clinical…
Runs On
What it takes to serve OpenMed-NER-BloodCancerDetect-TinyMed-65M (65M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 0.1 GB | 0.2 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 0.1 GB | 0.1 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.0 GB | 0.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 16, 2026.
Model Card
By OpenMed, published under apache-2.0, revision 62684ec5a6a2.
Specialized model for Clinical Entity Recognition - Clinical entities related to Chronic Lymphocytic Leukemia
Model Overview
This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for clinical entity recognition - clinical entities related to chronic lymphocytic leukemia. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for clinical and research applications.
Key Features
- High Precision: Optimized for biomedical entity recognition
- Domain-Specific: Trained on curated CLL dataset
- Production-Ready: Validated on clinical benchmarks
- Easy Integration: Compatible with Hugging Face Transformers ecosystem
Supported Entity Types
This model can identify and classify the following biomedical entities:
B-CLI-CL
Dataset
CLL corpus is specialized for chronic lymphocytic leukemia entity recognition in hematology and cancer research.
Configuration
- Architecture
- DistilBertForTokenClassification
- Context length (tokens)
- 512
- Vocabulary size
- 28,996
- Stored precision
- bfloat16
- Model type
- distilbert
Identity and Version
- Repository
- OpenMed/OpenMed-NER-BloodCancerDetect-TinyMed-65M
- Publisher
- OpenMed
- Task
- Token classification
- Modality
- Text
- Library
- transformers
- Parameters
- 65M parameters
- Languages
- en
- Revision
- 62684ec5a6a211b91b7d5e33e7e6af95917b93ad
- First published
- 2025-07-16
- Last updated
- 2025-08-05
Files and Weights
10 files, 131.8 MB in total. The weights are 1 file totalling 130.4 MB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors | Weights | 130.4 MB | 903a33336858 |
| config.json | Configuration | 671 B | — |
| special_tokens_map.json | Configuration | 125 B | — |
| test_results.json | Configuration | 185 B | — |
| README.md | Documentation | 11.7 KB | — |
| openmed_vs_sota_grouped_bars.png | Other | 497.0 KB | 626b37d9b20c |
| .gitattributes | Repository | 1.6 KB | — |
| tokenizer.json | Tokenizer | 669.2 KB | — |
| tokenizer_config.json | Tokenizer | 1.2 KB | — |
| vocab.txt | Tokenizer | 213.4 KB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 130.4 MB
Released by OpenMed through its official repository on Hugging Face. Read the license.
Built From
- Described by arXiv:2508.01630
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 130.4 MB |
| 16-bit | 0.1 GB |
| 8-bit | 0.1 GB |
| 4-bit | 0.0 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About OpenMed-NER-BloodCancerDetect-TinyMed-65M
How much GPU memory does OpenMed-NER-BloodCancerDetect-TinyMed-65M need?
About 0.2 GB at 16-bit and 0 GB at 4-bit: the weights (65M parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run OpenMed-NER-BloodCancerDetect-TinyMed-65M on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use OpenMed-NER-BloodCancerDetect-TinyMed-65M commercially?
Yes. OpenMed-NER-BloodCancerDetect-TinyMed-65M is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
What is OpenMed-NER-BloodCancerDetect-TinyMed-65M's context length?
512 tokens, from the maximum position embeddings in its published configuration.
Similar Models
An English Named Entity Recognition model, trained on Maccrobat to recognize the bio-medical entities (107 entities) from a given text corpus (case reports etc.). This model was built on top of distilbert-base-uncased Checkout the tutorial video for explanation of this model and corresponding python library: https://youtu.be/xpiDPdBpS18 The easiest way is to load the inference api from huggingface and second method is through the pipeline object offered by transformers library. This model is part of the Research topic "AI in Biomedical field" conducted by Deepak John Reji, Shaina Raza. If you use this work (code, model or dataset), please star at
Specialized model for Species Entity Recognition - Species names from the Species-800 dataset This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for species entity recognition - species names from the species-800 dataset. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for clinical and research…
A 35M-parameter token tagger for personal data in Chinese and mixed Chinese–English text. It is a fine-tune of cjhwong/seatbelt-pii-tagger with the same architecture, tokenizer and 18 types / 73 BIOES labels. - real Chinese contexts (FineWeb-2) with inserted synthetic private names and addresses; - self-distillation replay, which aims to reduce forgetting of the base model's other types and its English behaviour. - It misses fewer Chinese person names. On test sets never used during development, person recall rises by about 2 to 10 points; precision moves between −3.5 and +3.5 points. - +0.6 to +2.1 on two freshly generated test sets; - +4.2 to +6.7 on an MSRA NER train sample (never used…
This model is a fine-tuned version of BAAI/bge-small-en-v1.5 on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 2e-05 - trainbatchsize: 16 - evalbatchsize: 16 - lrschedulertype: linear - numepochs: 10 - Transformers 4.50.0 - Pytorch 2.11.0+cu128 - Datasets 3.4.1 - Tokenizers 0.21.4
Token-classification model for PII detection, fine-tuned from prajjwal1/bert-small on Detect personally identifiable information (PII) spans in english text. Suitable for privacy filtering, redaction pipelines, and data-leak prevention particularly on structured data (JSON, HTML, XML, SQL, Document) English-focused; other languages will degrade External-corpus evaluation (English only), seqeval. Last run: 2026-05-21. Data citation are present in the dataset card used for this model. If you use the model, please consider citing the papers