A 35M-parameter token tagger for personal data in Chinese and mixed Chinese–English text. It is a fine-tune of cjhwong/seatbelt-pii-tagger with the same architecture, tokenizer and 18 types / 73 BIOES labels. - real Chinese contexts (FineWeb-2) with inserted synthetic private names and addresses; - self-distillation replay, which aims to reduce forgetting of the base model's other types and its English behaviour. - It misses fewer Chinese person names. On test sets never used during development, person recall rises by about 2 to 10 points; precision moves between −3.5 and +3.5 points. - +0.6 to +2.1 on two freshly generated test sets; - +4.2 to +6.7 on an MSRA NER train sample (never used…
Open-weight model · Token classification
bge-small-ner-early-stopping
by Arslan Yamaletdinov arslanyam/bge-small-ner-early-stopping
bge-small-ner-early-stopping is an open-weight model for token classification from Arslan Yamaletdinov, released under MIT License. It has 33M parameters and a 512-token context. At 16-bit it needs about 0.1 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.
This model is a fine-tuned version of BAAI/bge-small-en-v1.5 on an unknown dataset.
Runs On
What it takes to serve bge-small-ner-early-stopping (33M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 0.1 GB | 0.1 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 0.0 GB | 0.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.0 GB | 0.0 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.
bge-small-ner-early-stopping on every accelerator the SAVRN Index prices, at every precision
Model Card
By Arslan Yamaletdinov, published under mit, revision b35e503b2a3c.
This model is a fine-tuned version of BAAI/bge-small-en-v1.5 on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 2e-05 - trainbatchsize: 16 - evalbatchsize: 16 - lrschedulertype: linear - numepochs: 10 - Transformers 4.50.0 - Pytorch 2.11.0+cu128 - Datasets 3.4.1 - Tokenizers 0.21.4
Read Arslan Yamaletdinov's full model card
This model is a fine-tuned version of BAAI/bge-small-en-v1.5 on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.0814 - Precision: 0.8982 - Recall: 0.9239 - F1: 0.9109 - Accuracy: 0.9814
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training: - learning_rate: 2e-05 - train_batch_size: 16 - eval_batch_size: 16 - seed: 42 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - num_epochs: 10
Training results
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
|---|---|---|---|---|---|---|---|
| 0.4629 | 1.0 | 625 | 0.1731 | 0.7698 | 0.8211 | 0.7946 | 0.9629 |
| 0.1715 | 2.0 | 1250 | 0.1127 | 0.8544 | 0.8921 | 0.8729 | 0.9757 |
| 0.1158 | 3.0 | 1875 | 0.0934 | 0.8609 | 0.9093 | 0.8844 | 0.9774 |
| 0.0687 | 4.0 | 2500 | 0.0858 | 0.8854 | 0.9150 | 0.8999 | 0.9803 |
| 0.0559 | 5.0 | 3125 | 0.0845 | 0.8817 | 0.9185 | 0.8998 | 0.9790 |
| 0.0454 | 6.0 | 3750 | 0.0811 | 0.8853 | 0.9196 | 0.9021 | 0.9798 |
| 0.0432 | 7.0 | 4375 | 0.0816 | 0.8876 | 0.9226 | 0.9048 | 0.9802 |
| 0.0336 | 8.0 | 5000 | 0.0815 | 0.8983 | 0.9231 | 0.9105 | 0.9813 |
| 0.0304 | 9.0 | 5625 | 0.0816 | 0.9005 | 0.9241 | 0.9121 | 0.9815 |
| 0.0296 | 10.0 | 6250 | 0.0814 | 0.8982 | 0.9239 | 0.9109 | 0.9814 |
Framework versions
- Transformers 4.50.0
- Pytorch 2.11.0+cu128
- Datasets 3.4.1
- Tokenizers 0.21.4
Configuration
- Architecture
- BertForTokenClassification
- Context length (tokens)
- 512
- Layers
- 12
- Hidden size
- 384
- Feed-forward size
- 1,536
- Attention heads
- 12
- Vocabulary size
- 30,522
- Stored precision
- float32
- Model type
- bert
Identity and Version
- Repository
- arslanyam/bge-small-ner-early-stopping
- Publisher
- Arslan Yamaletdinov
- Task
- Token classification
- Modality
- Text
- Library
- transformers
- Parameters
- 33M parameters
- Languages
- Not stated by the source
- Revision
- b35e503b2a3c64f9330c233408648cb52f645c8e
- First published
- 2026-10-08
- Last updated
- 2026-10-08
Files and Weights
9 files, 133.8 MB in total. The weights are 2 files totalling 132.9 MB in bin, safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors | Weights | 132.9 MB | c67f3e42af80 |
| training_args.bin | Weights | 5.8 KB | 043ceb5bb19e |
| config.json | Configuration | 942 B | — |
| special_tokens_map.json | Configuration | 695 B | — |
| README.md | Documentation | 2.5 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
| tokenizer.json | Tokenizer | 711.5 KB | — |
| tokenizer_config.json | Tokenizer | 1.3 KB | — |
| vocab.txt | Tokenizer | 231.5 KB | — |
License and Download
- License
- mit
- Access
- Open weights, no gate
- Download size
- 132.9 MB
Released by Arslan Yamaletdinov through its official repository on Hugging Face. Read the license.
Built From
- Derived from BAAI/bge-small-en-v1.5
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 132.9 MB |
| 16-bit | 0.1 GB |
| 8-bit | 0.0 GB |
| 4-bit | 0.0 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About bge-small-ner-early-stopping
How much GPU memory does bge-small-ner-early-stopping need?
About 0.1 GB at 16-bit and 0 GB at 4-bit: the weights (33M parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run bge-small-ner-early-stopping on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use bge-small-ner-early-stopping commercially?
Yes. bge-small-ner-early-stopping is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.
What is bge-small-ner-early-stopping's context length?
512 tokens, from the maximum position embeddings in its published configuration.
Similar Models
Token-classification model for PII detection, fine-tuned from prajjwal1/bert-small on Detect personally identifiable information (PII) spans in english text. Suitable for privacy filtering, redaction pipelines, and data-leak prevention particularly on structured data (JSON, HTML, XML, SQL, Document) English-focused; other languages will degrade External-corpus evaluation (English only), seqeval. Last run: 2026-05-21. Data citation are present in the dataset card used for this model. If you use the model, please consider citing the papers
This model is a fine-tuned version of monologg/koelectra-small-v3-discriminator on an unknown dataset. It achieves the following results on the evaluation set: 태깅 시스템: BIO 시스템 한국정보통신기술협회(TTA) 대분류 기준을 따르는 15 가지의 태그셋 You can use this model with Transformers pipeline for NER. 개체명 인식(NER) 모델 학습 데이터 셋 - https://corpus.korean.go.kr/request/reausetMain.do The following hyperparameters were used during training: - learningrate: 5e-05 - trainbatchsize: 64 - evalbatchsize: 64 - lrschedulertype: linear - lrschedulerwarmupsteps: 15151 - numepochs: 20 - mixedprecisiontraining: Native AMP - Transformers 4.27.4 - Pytorch 2.0.0+cu118 - Datasets 2.11.0 - Tokenizers 0.13.3
Specialized model for Clinical Entity Recognition - Clinical entities related to Chronic Lymphocytic Leukemia This model is a state-of-the-art fine-tuned transformer engineered to deliver enterprise-grade accuracy for clinical entity recognition - clinical entities related to chronic lymphocytic leukemia. This specialized model excels at identifying and extracting biomedical entities from clinical texts, research papers, and healthcare documents, enabling applications such as drug interaction detection, medication extraction from patient records, adverse event monitoring, literature mining for drug discovery, and biomedical knowledge graph construction with production-ready reliability for…
If my open source models have been useful to you, please consider supporting me in building small, useful AI models for everyone (and help me afford med school / help out my parents financially). Thanks! distilbert-NER is the fine-tuned version of DistilBERT, which is a distilled variant of the BERT model. DistilBERT has fewer parameters than BERT, making it smaller, faster, and more efficient. distilbert-NER is specifically fine-tuned for the task of Named Entity Recognition (NER). This model accurately identifies the same four types of entities as its BERT counterparts: location (LOC), organizations (ORG), person (PER), and Miscellaneous (MISC). Although it is a more compact model…
An English Named Entity Recognition model, trained on Maccrobat to recognize the bio-medical entities (107 entities) from a given text corpus (case reports etc.). This model was built on top of distilbert-base-uncased Checkout the tutorial video for explanation of this model and corresponding python library: https://youtu.be/xpiDPdBpS18 The easiest way is to load the inference api from huggingface and second method is through the pipeline object offered by transformers library. This model is part of the Research topic "AI in Biomedical field" conducted by Deepak John Reji, Shaina Raza. If you use this work (code, model or dataset), please star at