SAVRN
Search Contact SAVRN

Open-weight model · Token classification

KoELECTRA-small-v3-modu-ner

by Leo Kang Leo97/KoELECTRA-small-v3-modu-ner

This model is a fine-tuned version of monologg/koelectra-small-v3-discriminator on an unknown dataset.

Parameters14M
Context512
Weights112.6 MB
License
AccessOpen weights
Monthly Downloads401.8k

Runs On

What it takes to serve KoELECTRA-small-v3-modu-ner (14M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.0 GB 0.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

This model is a fine-tuned version of monologg/koelectra-small-v3-discriminator on an unknown dataset. It achieves the following results on the evaluation set: 태깅 시스템: BIO 시스템 한국정보통신기술협회(TTA) 대분류 기준을 따르는 15 가지의 태그셋 You can use this model with Transformers pipeline for NER. 개체명 인식(NER) 모델 학습 데이터 셋 - https://corpus.korean.go.kr/request/reausetMain.do The following hyperparameters were used during training: - learningrate: 5e-05 - trainbatchsize: 64 - evalbatchsize: 64 - lrschedulertype: linear - lrschedulerwarmupsteps: 15151 - numepochs: 20 - mixedprecisiontraining: Native AMP - Transformers 4.27.4 - Pytorch 2.0.0+cu118 - Datasets 2.11.0 - Tokenizers 0.13.3

Excerpt from the card by Leo Kang.

Configuration

Architecture
ElectraForTokenClassification
Context length (tokens)
512
Layers
12
Hidden size
256
Feed-forward size
1,024
Attention heads
4
Vocabulary size
35,000
Stored precision
float32
Model type
electra

Identity and Version

Repository
Leo97/KoELECTRA-small-v3-modu-ner
Publisher
Leo Kang
Task
Token classification
Modality
Text
Library
transformers
Parameters
14M parameters
Languages
ko
Revision
bb9d562674e260712d9779f140ff5564a9e44d36
First published
2023-03-29
Last updated
2023-04-07

Files and Weights

25 files, 113.8 MB in total. The weights are 3 files totalling 112.6 MB in bin, safetensors.

Weights3 files · 112.6 MB
Configuration2 files · 2.0 KB
Tokenizer3 files · 1.1 MB
Documentation1 file · 5.6 KB
Other14 files · 105.8 KB
Repository2 files · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights56.3 MB c7613112988b
pytorch_model.binWeights56.3 MB 6d572aed6fa7
training_args.binWeights3.6 KB 56828df94887
config.jsonConfiguration1.9 KB
special_tokens_map.jsonConfiguration125 B
README.mdDocumentation5.6 KB
runs/Apr03_02-10-29_9f8a0a3a5bbf/1680487868.0161226/events.out.tfevents.1680487868.9f8a0a3a5bbf.543.1Other5.9 KB 5aa5fa210fcc
runs/Apr03_02-10-29_9f8a0a3a5bbf/events.out.tfevents.1680487868.9f8a0a3a5bbf.543.0Other10.8 KB 9aebe2540054
runs/Apr05_03-30-38_5b47c4ecdbee/1680665525.2874877/events.out.tfevents.1680665525.5b47c4ecdbee.452.1Other5.9 KB c99bab261610
runs/Apr05_03-30-38_5b47c4ecdbee/events.out.tfevents.1680665525.5b47c4ecdbee.452.0Other7.2 KB 6e3f2c806537
runs/Apr05_05-16-04_010a653d2914/1680671809.7113647/events.out.tfevents.1680671809.010a653d2914.146.1Other5.9 KB 8a97443e4c3a
runs/Apr05_05-16-04_010a653d2914/events.out.tfevents.1680671809.010a653d2914.146.0Other8.1 KB 64a044650304
runs/Apr07_03-09-05_adf6afa1096d/1680837002.4824874/events.out.tfevents.1680837002.adf6afa1096d.4586.1Other5.9 KB 40cfbea78f57
runs/Apr07_03-09-05_adf6afa1096d/events.out.tfevents.1680837002.adf6afa1096d.4586.0Other15.6 KB e982294771be
runs/Mar29_05-40-00_f57d0dd35d0a/1680068508.4352155/events.out.tfevents.1680068508.f57d0dd35d0a.195.1Other5.8 KB 211af70f5fbf
runs/Mar29_05-40-00_f57d0dd35d0a/events.out.tfevents.1680068508.f57d0dd35d0a.195.0Other10.7 KB 96de636e7e75
runs/Mar31_08-59-31_efb60e2b93ff/1680253186.4787786/events.out.tfevents.1680253186.efb60e2b93ff.189.1Other6.1 KB bd4562c4558b
runs/Mar31_08-59-31_efb60e2b93ff/events.out.tfevents.1680253186.efb60e2b93ff.189.0Other6.1 KB db19cd103b25
runs/Mar31_09-24-05_efb60e2b93ff/1680254654.5058205/events.out.tfevents.1680254654.efb60e2b93ff.189.3Other5.9 KB ed63abc05004
runs/Mar31_09-24-05_efb60e2b93ff/events.out.tfevents.1680254654.efb60e2b93ff.189.2Other6.1 KB eec3d271965d
.gitattributesRepository1.5 KB
.gitignoreRepository13 B
tokenizer.jsonTokenizer814.9 KB
tokenizer_config.jsonTokenizer365 B
vocab.txtTokenizer263.3 KB

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
112.6 MB
Download from Leo Kang

Released by Leo Kang through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published112.6 MB
16-bit0.0 GB
8-bit0.0 GB
4-bit0.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About KoELECTRA-small-v3-modu-ner

How much GPU memory does KoELECTRA-small-v3-modu-ner need?

About 0 GB at 16-bit and 0 GB at 4-bit: the weights (14M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run KoELECTRA-small-v3-modu-ner on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is KoELECTRA-small-v3-modu-ner's context length?

512 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Token classification

stanford-deidentifier-base

Stanford AIMI

Stanford de-identifier was trained on a variety of radiology and biomedical documents with the goal of automatising the de-identification process while reaching satisfactory accuracy for use in production. Manuscript in-proceedings. These model weights are the recommended ones among all available deidentifier weights. This work was supported in part by the Medical Imaging and Data Resource Center (MIDRC), which is funded by the National Institute of Biomedical Imaging and Bioengineering (NIBIB) of the National Institutes of Health under contract 75N92020D00021 and through The Advanced Research Projects Agency for Health (ARPA-H)

Open weights mit 512 tokens transformers

Model · Token classification

bert-portuguese-ner

Luís Filipe Cunha

This model is a fine-tuned version of neuralmind/bert-base-portuguese-cased It achieves the following results on the evaluation set: This model was fine-tunned on token classification task (NER) on Portuguese archival documents. The annotated labels are: Date, Profession, Person, Place, Organization All the training and evaluation data is available at: http://ner.epl.di.uminho.pt/ The following hyperparameters were used during training: - learningrate: 2e-05 - trainbatchsize: 16 - evalbatchsize: 16 - lrschedulertype: linear - numepochs: 4 - Transformers 4.10.0.dev0 - Pytorch 1.9.0+cu111 - Datasets 1.10.2 - Tokenizers 0.10.3

Open weights mit 512 tokens transformers

Model · Token classification

privacy-filter-nemotron-GGUF

LocalAI-io

GGUF conversion of OpenMed/privacy-filter-nemotron, a fine-grained PII token-classification model — a fine-tune of openai/privacy-filter on the nvidia/Nemotron-PII dataset. It labels every token with a BIOES tag over 55 PII categories (221 classes) in a single forward pass, then decodes coherent spans with a constrained Viterbi procedure — so it can be served locally with no Python as the encoder/NER tier of a PII redactor. Where the base openai/privacy-filter covers 8 coarse categories, this fine-tune trades multilingual breadth for category depth: 55 fine-grained English categories (first/last name, government IDs, financial, healthcare, vehicle, digital, …). For the full model…

Open weights apache-2.0 gguf

Model · Token classification

punctuate-all

KREDOR

This is based on Oliver Guhr's work. The difference is that it is a finetuned xlm-roberta-base instead of an xlm-roberta-large and on twelve languages instead of four. The languages are: English, German, French, Spanish, Bulgarian, Italian, Polish, Dutch, Czech, Portugese, Slovak, Slovenian. precision recall f1-score support accuracy 0.98 84425503 macro avg 0.83 0.74 0.77 84425503 weighted avg 0.98 0.98 0.98 84425503

Open weights mit 514 tokens transformers

Model · Token classification

privacy-filter-multilingual-GGUF

LocalAI-io

GGUF conversion of OpenMed/privacy-filter-multilingual, a multilingual PII token-classification model (a fine-tune of openai/privacy-filter). It labels every token with a BIOES tag over 54 PII categories (217 classes) across 16 languages, so it can be served locally with no Python as the encoder/NER tier of a PII redactor. For the full model description, label space, evaluation, limitations, and citations, see the source model card — this card only covers the GGUF packaging and how to run it. This GGUF uses a custom architecture, openai-privacy-filter, that is not (yet) part of 1. privacy-filter.cpp (recommended) — a small standalone GGML engine for exactly this model family, on stock…

Open weights apache-2.0 gguf

Model · Token classification

unbiased-toxic-roberta-onnx

Protect AI

This model is a conversion of unitary/unbiased-toxic-roberta to ONNX format using the Optimum library. Trained models & code to predict toxic comments on 3 Jigsaw challenges: Toxic comment classification, Unintended Bias in Toxic comments, Multilingual toxic comment classification. Built by Laura Hanu at Unitary. The huggingface models currently give different results to the detoxify library (see issue here). All challenges have a toxicity label. The toxicity labels represent the aggregate ratings of up to 10 annotators according the following schema: - Very Toxic (a very hateful, aggressive, or disrespectful comment that is very likely to make you leave a discussion or give up on sharing…

Open weights apache-2.0 514 tokens transformers