Model checkpoints for the paper Self-Play Pretraining with Zero Data. Two randomly initialized transformers are trained in tandem: a generator proposes programs for a minimal universal Turing machine, and a learner is trained by next-token prediction on the executed byte sequences. No natural data is used at any point during training. These checkpoints are the learners from that process, released so that every result in the paper can be recomputed from the weights. All models are byte-level (vocabulary 256) decoder-only Llama-style transformers with a 4096-token context. The main self-play ladder, six model sizes. Learner weights are saved every 256 self-play rounds; sizes refer to…
SAVRN Model Hub
Open-Weight Models
An open-weight model is an AI model whose trained weights are published for anyone to download. The weights are what the model learned in training. With a copy of them you can run the model on hardware you control and train it further on your own data.
Open weights are not the same as open source. Many publishers release the weights without the training data or code, and the license sets what you may do with the model. This library puts each model's full card, architecture, files, license and published evaluations on one page.
3,247Models
1,032Datasets
256Papers
2,088Publishers
5,461Sourced relationships
Updated 2026-09-20 · How the library is built
3,247 models, sorted by most downloaded.
GRPO with group-standardized answer correctness, without a STRIDE diversity bonus. Training explicitly renders enablethinking=False, recorded as thinkingmode: false in the scientific contract. The pinned tokenizer and chat template remain unchanged. Use the same explicit keyword at inference, particularly for Qwen3-1.7B, whose default template enables thinking. Every checkpoint in this repository requires explicit nonthinking provenance. This public repository retains every published optimizer-update adapter, including update zero (the initial, untrained adapter). Training is planned for 4 epochs on the same 2,048-question training split as the earlier STRIDE runs. The global prompt batch…
Model · Text generation
stride-qwen3-1.7b-nonthinking-stabilized-2048-local_positive-alpha05-20260917
STRIDE with nonnegative local step-diversity credit on eligible reasoning tokens. Training explicitly renders enablethinking=False, recorded as thinkingmode: false in the scientific contract. The pinned tokenizer and chat template remain unchanged. Use the same explicit keyword at inference, particularly for Qwen3-1.7B, whose default template enables thinking. Every checkpoint in this repository requires explicit nonthinking provenance. This public repository retains every published optimizer-update adapter, including update zero (the initial, untrained adapter). Training is planned for 4 epochs on the same 2,048-question training split as the earlier STRIDE runs. The global prompt batch is…
Model · Text generation
stride-qwen3-1.7b-nonthinking-stabilized-2048-local_positive-alpha2-20260916
STRIDE with nonnegative local step-diversity credit on eligible reasoning tokens. Training explicitly renders enablethinking=False, recorded as thinkingmode: false in the scientific contract. The pinned tokenizer and chat template remain unchanged. Use the same explicit keyword at inference, particularly for Qwen3-1.7B, whose default template enables thinking. Every checkpoint in this repository requires explicit nonthinking provenance. This public repository retains every published optimizer-update adapter, including update zero (the initial, untrained adapter). Training is planned for 4 epochs on the same 2,048-question training split as the earlier STRIDE runs. The global prompt batch is…
Model Collections
Hand-picked starting points, each with the reason it exists.
Collection · 4 entries
Embedding models for retrieval
Sentence and document embedding models used to build retrieval systems. Dimension and sequence length matter more than size here, and both come from the publisher.
Collection · 4 entries
Models that fit on one accelerator
Models whose publisher-reported parameter count puts them within reach of a single accelerator at common precisions. Memory needed depends on precision and serving configuration, so treat the parameter count as the starting point, not the answer.
Collection · 6 entries
Open-weight text models worth knowing
Widely used open-weight language models, chosen because each one is a distinct family rather than a variant of the one above it. Selection, not a ranking.
Collection · 3 entries
Speech and audio models
Recognition and synthesis models, grouped so the two directions are easy to compare.
Open-Weight Models Explained
What is an open-weight model?
An AI model whose trained weights are published for anyone to download, so it can be run, tested and fine-tuned on hardware the user controls.
Is an open-weight model the same as open source?
Not always. Open weights means the trained model can be downloaded. Open source usually also means the training code and data are available and the license allows broad reuse. Many open-weight models release the weights only.
Can I use an open-weight model commercially?
It depends on the license. Apache 2.0 and MIT allow commercial use. Other licenses limit it, for example to non-commercial use or below a set number of users. Every model page here shows its license.
How much memory does an open-weight model need?
About two bytes per parameter at 16-bit precision, so a 7-billion-parameter model needs roughly 14 GB for its weights, plus memory for the context it processes. Each model page lists its parameter count and the size of its files.
Related SAVRN Research
The hub sits beside SAVRN's market data and infrastructure research: what models cost to run, and what it takes to run them.
SAVRN Index
What open models cost to run
The same open-weight model priced by every host that serves it, per million tokens.
Research Hub
Data center trackers and maps
Moratoriums, permits, power, water and capital behind the facilities that run these models.
Method
How the Model Hub is built
Sources, evidence labels, refresh behaviour, and the limits of every comparison here.