SAVRN
Search Contact SAVRN

Organization

Bench Labs

bench-labs

Exploring artificial intelligence together. Open source

Models in Library1
Datasets in Library0
Models on Hugging Face15
Followers49

Models

Model · Text generation

cagliostro-v3

Bench Labs

A 146M parameter decoder-only language model pretrained from scratch on 75B tokens of open web, synthetic textbook and mathematics data. It is the third model in the cagliostro line and the first to clear an Index of 26 on the Open SLM Leaderboard metric. Zero-shot, measured with lm-evaluation-harness and the leaderboard's own ArithMark-3 script, on the exported float32 weights in this repository. The Index is the leaderboard's own formula, (N(HellaSwag,25) + N(CombinedARC,25) + N(PIQA,50) + 0.65N(ArithMark,25)) / 3.65 where N(v,c) = 100(v-c)/(100-c) and CombinedARC is the mean of ARC-Easy and ARC-Challenge. For context against other models at this scale, using the leaderboard's published…

Open weights apache-2.0 146M parameters 2,048 tokens transformers