Error guarantees for small medical language models keep their promise by staying silent. Koushik Swarna · Invariance Labs · [email protected] A safety certificate lets a model answer only when it is confident, and promises that the error rate on its answers stays under a budget α in all but δ = 5% of deployments. We prove three short facts, test them on 10 small open models, 4 medical benchmarks, and 40,000 simulated deployments, and find that all three hold. Use the certificate on your own scores: 1. Score: python scripts/scoremodels.py --model Qwen/Qwen2.5-1.5B-Instruct --questions medqa.jsonl --out scores/qwen1.5bmedqa.npz. Add --nf4 for 4-bit models. Confidence is the softmax…
Independent publisher
Koushik
koushiks29292
Models in Library1
Datasets in Library0
Models on Hugging Face1
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Reported licenses: mit. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.