SAVRN
Search Contact SAVRN

Open-weight model · Text classification

typed-decisions-minilm-l6-specialist

by Adaptive Classifier adaptive-classifier/typed-decisions-minilm-l6-specialist

typed-decisions-minilm-l6-specialist is an open-weight model for text classification from Adaptive Classifier, released under Apache License 2.0. Its published files total 22.6 MB.

A specialist for the Typed Decisions (workflow, question) on a frozen sentence-transformers/all-MiniLM-L6-v2 encoder, 20 heads in total.

Parameters—
Context—
Weights17.9 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By Adaptive Classifier, published under apache-2.0, revision e3182b215371.

A specialist for the Typed Decisions (workflow, question) on a frozen sentence-transformers/all-MiniLM-L6-v2 encoder, 20 heads in total. Each head takes the rendered state, the question text and its options, and returns a probability distribution over the question's labels. This is not zero-shot. It was fitted on the 1,200-case train split of Typed Decisions and is scored on the 400-case test split. Per the benchmark's own rules it is a specialist, and should not be compared with generalist models that answer unseen question schemas. "This run" is the model in this repository, fitted and scored from the public dataset with adaptive-classifier 0.2.0 on Apple MPS, and scored by the benchmark…

Read Adaptive Classifier's full model card

A specialist for the Typed Decisions benchmark: one AdaptiveClassifier head per (workflow, question) on a frozen sentence-transformers/all-MiniLM-L6-v2 encoder, 20 heads in total. Each head takes the rendered state, the question text and its options, and returns a probability distribution over the question's labels.

This is not zero-shot. It was fitted on the 1,200-case train split of Typed Decisions and is scored on the 400-case test split. Per the benchmark's own rules it is a specialist, and should not be compared with generalist models that answer unseen question schemas.

Results (test split, 400 cases, 2,000 decisions)

Metric This run Benchmark README
Accuracy 0.607 0.587
KL from gold (lower is better) 0.249 0.262
Brier (lower is better) 0.136 0.143
ECE (lower is better) 0.136 0.108

"This run" is the model in this repository, fitted and scored from the public dataset with adaptive-classifier 0.2.0 on Apple MPS, and scored by the benchmark maintainers on the test split. Full per-question numbers are in results.json.

Recipe

  • Encoder sentence-transformers/all-MiniLM-L6-v2, frozen, max_length 512, mean pooling.
  • One AdaptiveClassifier per (workflow, question), prototype weight 0.3, 30 epochs, seed 42.
  • score questions are treated as ordinal classes and decoded to an expected score.
  • Each training case is entered 4 times, split across labels in proportion to the gold distribution (soft replicas).
  • Hyperparameters were tuned on a held-out slice of train, never on test.

Usage

# pip install adaptive-classifier==0.2.0 torch transformers
from predict import Specialist
m = Specialist("."); print(m.predict(workflow, state, questions))   # questions in the benchmark's wire format

python3 predict.py case.json does the same from a JSON file. python3 predict.py --test-ref checks that the reloaded heads reproduce the saved predictions for the first 20 test cases. The encoder is downloaded from the Hub on first load and shared by all heads.

Limits

  • It only answers the question schemas of the four workflows it was trained on (agent_trace_observability, customer_service, invoice_processing, security_incidents). Any other question gets a uniform answer.
  • It learns the teacher's labels. The gold is the mean of three samples from a roughly 4B-class teacher, so a score measures agreement with that teacher, not correctness (see the benchmark README).
  • Synthetic data only; no claim is made about real-world tickets, invoices or incidents.

Links

  • Dataset: https://huggingface.co/datasets/LocalLLaMA/typed-decisions
  • Library: https://github.com/codelion/adaptive-classifier

Identity and Version

Repository
adaptive-classifier/typed-decisions-minilm-l6-specialist
Publisher
Adaptive Classifier
Task
Text classification
Modality
Text
Library
adaptive-classifier
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
e3182b21537101923183436fdfb7566c8e3524b3
First published
2026-10-02
Last updated
2026-10-08

Files and Weights

87 files, 22.6 MB in total. The weights are 20 files totalling 17.9 MB in safetensors.

Weights20 files · 17.9 MB
Configuration45 files · 4.6 MB
Documentation21 files · 45.4 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
heads/agent_trace_observability__action/model.safetensorsWeights897.2 KB 806d60822271
heads/agent_trace_observability__needs_review/model.safetensorsWeights892.4 KB 0c3e412ffead
heads/agent_trace_observability__outcome/model.safetensorsWeights897.2 KB 48c9d96d426e
heads/agent_trace_observability__risk/model.safetensorsWeights897.1 KB d64929a92a56
heads/agent_trace_observability__urgency/model.safetensorsWeights897.1 KB dcdcbd2b73cd
heads/customer_service__action/model.safetensorsWeights899.6 KB aed2d365900d
heads/customer_service__category/model.safetensorsWeights899.5 KB 1f38b5d02beb
heads/customer_service__churn_risk/model.safetensorsWeights897.1 KB e79b484ef7cc
heads/customer_service__needs_human/model.safetensorsWeights892.4 KB 41185323ff79
heads/customer_service__urgency/model.safetensorsWeights897.1 KB 5064b51d78b4
heads/invoice_processing__discrepancy_severity/model.safetensorsWeights897.1 KB 8086ec67e174
heads/invoice_processing__disposition/model.safetensorsWeights897.2 KB 01d444dc08bf
heads/invoice_processing__duplicate/model.safetensorsWeights892.4 KB 4baa445c3a59
heads/invoice_processing__matches_order/model.safetensorsWeights892.4 KB 525ac66c3b55
heads/invoice_processing__urgency/model.safetensorsWeights897.1 KB 3edb192bb4ad
heads/security_incidents__credential_compromise/model.safetensorsWeights892.4 KB 000ecb20e79f
heads/security_incidents__disposition/model.safetensorsWeights897.2 KB 6571bcddd7d4
heads/security_incidents__severity/model.safetensorsWeights899.5 KB 3cd5d55f8a78
heads/security_incidents__true_positive/model.safetensorsWeights892.4 KB 805324ff7374
heads/security_incidents__urgency/model.safetensorsWeights897.1 KB d101c6d5d379
.eval_results/typed-decisions.yamlConfiguration1.5 KB —
heads/agent_trace_observability__action/config.jsonConfiguration1.6 KB —
heads/agent_trace_observability__action/examples.jsonConfiguration246.3 KB —
heads/agent_trace_observability__needs_review/config.jsonConfiguration1.4 KB —
heads/agent_trace_observability__needs_review/examples.jsonConfiguration121.2 KB —
heads/agent_trace_observability__outcome/config.jsonConfiguration1.6 KB —
heads/agent_trace_observability__outcome/examples.jsonConfiguration247.8 KB —
heads/agent_trace_observability__risk/config.jsonConfiguration1.5 KB —
heads/agent_trace_observability__risk/examples.jsonConfiguration246.5 KB —
heads/agent_trace_observability__urgency/config.jsonConfiguration1.5 KB —
heads/agent_trace_observability__urgency/examples.jsonConfiguration246.1 KB —
heads/customer_service__action/config.jsonConfiguration1.8 KB —
heads/customer_service__action/examples.jsonConfiguration276.5 KB —
heads/customer_service__category/config.jsonConfiguration1.6 KB —
heads/customer_service__category/examples.jsonConfiguration325.4 KB —
heads/customer_service__churn_risk/config.jsonConfiguration1.5 KB —
heads/customer_service__churn_risk/examples.jsonConfiguration258.5 KB —
heads/customer_service__needs_human/config.jsonConfiguration1.4 KB —
heads/customer_service__needs_human/examples.jsonConfiguration128.5 KB —
heads/customer_service__urgency/config.jsonConfiguration1.5 KB —
heads/customer_service__urgency/examples.jsonConfiguration258.3 KB —
heads/invoice_processing__discrepancy_severity/config.jsonConfiguration1.5 KB —
heads/invoice_processing__discrepancy_severity/examples.jsonConfiguration257.8 KB —
heads/invoice_processing__disposition/config.jsonConfiguration1.6 KB —
heads/invoice_processing__disposition/examples.jsonConfiguration258.7 KB —
heads/invoice_processing__duplicate/config.jsonConfiguration1.4 KB —
heads/invoice_processing__duplicate/examples.jsonConfiguration126.6 KB —
heads/invoice_processing__matches_order/config.jsonConfiguration1.4 KB —
heads/invoice_processing__matches_order/examples.jsonConfiguration126.9 KB —
heads/invoice_processing__urgency/config.jsonConfiguration1.5 KB —
heads/invoice_processing__urgency/examples.jsonConfiguration257.0 KB —
heads/security_incidents__credential_compromise/config.jsonConfiguration1.4 KB —
heads/security_incidents__credential_compromise/examples.jsonConfiguration125.8 KB —
heads/security_incidents__disposition/config.jsonConfiguration1.6 KB —
heads/security_incidents__disposition/examples.jsonConfiguration257.2 KB —
heads/security_incidents__severity/config.jsonConfiguration1.5 KB —
heads/security_incidents__severity/examples.jsonConfiguration321.6 KB —
heads/security_incidents__true_positive/config.jsonConfiguration1.4 KB —
heads/security_incidents__true_positive/examples.jsonConfiguration125.6 KB —
heads/security_incidents__urgency/config.jsonConfiguration1.5 KB —
heads/security_incidents__urgency/examples.jsonConfiguration255.4 KB —
predict.pyConfiguration4.0 KB —
predictor_config.jsonConfiguration944 B —
reference_predictions_first20.jsonConfiguration16.1 KB —
results.jsonConfiguration62.3 KB —
README.mdDocumentation3.1 KB —
heads/agent_trace_observability__action/README.mdDocumentation2.1 KB —
heads/agent_trace_observability__needs_review/README.mdDocumentation2.1 KB —
heads/agent_trace_observability__outcome/README.mdDocumentation2.1 KB —
heads/agent_trace_observability__risk/README.mdDocumentation2.1 KB —
heads/agent_trace_observability__urgency/README.mdDocumentation2.1 KB —
heads/customer_service__action/README.mdDocumentation2.2 KB —
heads/customer_service__category/README.mdDocumentation2.2 KB —
heads/customer_service__churn_risk/README.mdDocumentation2.1 KB —
heads/customer_service__needs_human/README.mdDocumentation2.1 KB —
heads/customer_service__urgency/README.mdDocumentation2.1 KB —
heads/invoice_processing__discrepancy_severity/README.mdDocumentation2.1 KB —
heads/invoice_processing__disposition/README.mdDocumentation2.1 KB —
heads/invoice_processing__duplicate/README.mdDocumentation2.1 KB —
heads/invoice_processing__matches_order/README.mdDocumentation2.1 KB —
heads/invoice_processing__urgency/README.mdDocumentation2.1 KB —
heads/security_incidents__credential_compromise/README.mdDocumentation2.1 KB —
heads/security_incidents__disposition/README.mdDocumentation2.1 KB —
heads/security_incidents__severity/README.mdDocumentation2.1 KB —
heads/security_incidents__true_positive/README.mdDocumentation2.1 KB —
heads/security_incidents__urgency/README.mdDocumentation2.1 KB —
.gitattributesRepository1.5 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
17.9 MB
Download from Adaptive Classifier

Released by Adaptive Classifier through its official repository on Hugging Face. Read the license.

Built From

  • Trained on (disclosed) LocalLLaMA/typed-decisions

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
LocalLLaMA/typed-decisions Task accuracyMetric accuracySetup Fine-tuned on the benchmark's train split (specialist per workflow), not zero-shot. Scored by the benchmark maintainers on the test split.Comparison conditions not established 0.607 Typed Decisions leaderboard (README)
Reported by a third party
Evaluated revision not stated 2026-10-08
LocalLLaMA/typed-decisions Task brierMetric brierSetup Fine-tuned on the benchmark's train split (specialist per workflow), not zero-shot. Scored by the benchmark maintainers on the test split.Comparison conditions not established 0.136 Typed Decisions leaderboard (README)
Reported by a third party
Evaluated revision not stated 2026-10-08
LocalLLaMA/typed-decisions Task eceMetric eceSetup Fine-tuned on the benchmark's train split (specialist per workflow), not zero-shot. Scored by the benchmark maintainers on the test split.Comparison conditions not established 0.136 Typed Decisions leaderboard (README)
Reported by a third party
Evaluated revision not stated 2026-10-08
LocalLLaMA/typed-decisions Task kl_from_goldMetric kl_from_goldSetup Fine-tuned on the benchmark's train split (specialist per workflow), not zero-shot. Scored by the benchmark maintainers on the test split.Comparison conditions not established 0.249 Typed Decisions leaderboard (README)
Reported by a third party
Evaluated revision not stated 2026-10-08

Memory Requirements

PrecisionWeights in memory
As published17.9 MB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About typed-decisions-minilm-l6-specialist

Can I use typed-decisions-minilm-l6-specialist commercially?

Yes. typed-decisions-minilm-l6-specialist is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text classification

twitter-roberta-base-sentiment-latest

Cardiff NLP

This is a RoBERTa-base model trained on ~124M tweets from January 2018 to December 2021, and finetuned for sentiment analysis with the TweetEval benchmark. The original Twitter-based RoBERTa model can be found here and the original reference paper is TweetEval. This model is suitable for English. 0 -> Negative; 1 -> Neutral; 2 -> Positive This sentiment analysis model has been integrated into TweetNLP. You can access the demo here.

Open weights cc-by-4.0 514 tokens transformers

Model · Text classification

finbert-tone

Yi

FinBERT is a BERT model pre-trained on financial communication text. The purpose is to enhance financial NLP research and practice. It is trained on the following three financial communication corpus. The total corpora size is 4.9B tokens. More technical details on FinBERT: Click Link This released finbert-tone model is the FinBERT model fine-tuned on 10,000 manually annotated (positive, negative, neutral) sentences from analyst reports. This model achieves superior performance on financial tone analysis task. If you are simply interested in using FinBERT for financial tone analysis, give it a try. If you use the model in your academic work, please cite the following paper: Huang, Allen H.…

Open weights 512 tokens transformers

Model · Text classification

ms-marco-MiniLM-L-6-v2

Joshua

https://huggingface.co/cross-encoder/ms-marco-MiniLM-L-6-v2 with ONNX weights to be compatible with Transformers.js. If you haven't already, you can install the Transformers.js JavaScript library from NPM using: Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).

Open weights 512 tokens transformers.js

Model · Text classification

twitter-xlm-roberta-base-sentiment

Cardiff NLP

This is a multilingual XLM-roBERTa-base model trained on ~198M tweets and finetuned for sentiment analysis. The sentiment fine-tuning was done on 8 languages (Ar, En, Fr, De, Hi, It, Sp, Pt) but it can be used for more languages (see paper for details). This model has been integrated into the TweetNLP library.

Open weights 514 tokens transformers

Model · Text classification

unbiased-toxic-roberta

Unitary

The huggingface models currently give different results to the detoxify library (see issue here). For the most up to date models we recommend using the models from https://github.com/unitaryai/detoxify Trained models & code to predict toxic comments on 3 Jigsaw challenges: Toxic comment classification, Unintended Bias in Toxic comments, Multilingual toxic comment classification. Built by Laura Hanu at Unitary, where we are working to stop harmful content online by interpreting visual content in context. Score not directly comparable since it is obtained on the validation set provided and not on the test set. To update when the test labels are made available. It is also noteworthy to mention…

Open weights apache-2.0 514 tokens transformers

Model · Text classification

emotion-english-distilroberta-base

Hartmann

With this model, you can classify emotions in English text data. The model was trained on 6 diverse datasets (see Appendix below) and predicts Ekman's 6 basic emotions, plus a neutral class: 1) anger 2) disgust 3) fear 4) joy 5) neutral 6) sadness 7) surprise The model is a fine-tuned checkpoint of DistilRoBERTa-base. For a 'non-distilled' emotion model, please refer to the model card of the RoBERTa-large version. a) Run emotion model with 3 lines of code on single text example using Hugging Face's pipeline command on Google Colab: b) Run emotion model on multiple examples and full datasets (e.g.,.csv files) on Google Colab: Please reach out to [email protected] if you have any…

Open weights 514 tokens transformers