libraryname: transformers - autotrain - text-classification basemodel: google-bert/bert-base-uncased f1macro: 0.7533020080884588 f1micro: 0.7533333333333333 f1weighted: 0.7533020080884587 precisionmacro: 0.7551310982162045 precisionmicro: 0.7533333333333333 precisionweighted: 0.7551310982162046 recallmacro: 0.7533333333333333 recallmicro: 0.7533333333333333 recallweighted: 0.7533333333333333
SAVRN Model Hub
Open-Weight Models
An open-weight model is an AI model whose trained weights are published for anyone to download. The weights are what the model learned in training. With a copy of them you can run the model on hardware you control and train it further on your own data.
Open weights are not the same as open source. Many publishers release the weights without the training data or code, and the license sets what you may do with the model. This library puts each model's full card, architecture, files, license and published evaluations on one page.
12,283Models
3,510Datasets
290Papers
7,436Publishers
12,632Sourced relationships
Updated 2026-10-22 · How the library is built
12,283 models, sorted by most downloaded.
A research-oriented Blip prototype targeting Contrastive. The included base setup documents defaults and file formats without presenting unverified performance numbers. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses adafactor with a cosine schedule. These are starting values in the script, not evidence of a completed run. For a…
Reading notes and an experiment sketch for Contrastive Learning. The repository emphasizes what still needs to be tested instead of manufacturing scores or release claims. - the scope of the research question and likely confounders - a proposed comparison with matched baselines - concrete evaluation context such as task-appropriate public benchmarks named in the main note - reproducibility checks, failure modes, and open questions - topic-relevant references Start with reading.md for the full note. Sections labeled as plans or hypotheses should not be interpreted as experimental results. If results are added later, they should include dataset versions, commands, seeds, hardware, and raw…
This repository is a compact, custom PyTorch implementation of Poolformer for Retrieval. The large configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release. - The Python file contains the model and runnable example or training entry point. - config.json records the generated architecture settings. - trainingargs.json records the default experiment recipe. - model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint. - No benchmark score is claimed in this repository. The included configuration uses rmsprop with a constant warmup schedule.…
AstralLM is a compact, efficient causal language model built for Hugging Face Transformers. It features a clean decoder-only transformer architecture with Grouped Query Attention (GQA), SwiGLU feed-forward networks, RoPE positional embeddings, and per-head QK-norm — delivering strong performance at a small parameter count (~138M). AstralLM is a decoder-only transformer with the following design choices: The model uses 8 query heads and 4 key/value heads (2:1 ratio), halving the KV cache memory footprint during inference without measurable quality degradation. Each head operates over a head dimension of 80. Per-head RMSNorm is applied to both query and key projections before the rotary…
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019). - PEFT 0.20.0
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct on the asynchowpythoncodeminutes dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 1e-05 - trainbatchsize: 1 - evalbatchsize: 1 - distributedtype: multi-GPU - gradientaccumulationsteps: 8 - totaltrainbatchsize: 8 - lrschedulertype: cosine - lrschedulerwarmupratio: 0.05 - numepochs: 2.0 - Transformers 4.57.6 - Pytorch 2.11.0+cu130 - Datasets 4.0.0 - Tokenizers 0.22.2
Model Collections
Hand-picked starting points, each with the reason it exists.
Collection · 4 entries
Embedding models for retrieval
Sentence and document embedding models used to build retrieval systems. Dimension and sequence length matter more than size here, and both come from the publisher.
Collection · 4 entries
Models that fit on one accelerator
Models whose publisher-reported parameter count puts them within reach of a single accelerator at common precisions. Memory needed depends on precision and serving configuration, so treat the parameter count as the starting point, not the answer.
Collection · 6 entries
Open-weight text models worth knowing
Widely used open-weight language models, chosen because each one is a distinct family rather than a variant of the one above it. Selection, not a ranking.
Collection · 3 entries
Speech and audio models
Recognition and synthesis models, grouped so the two directions are easy to compare.
Open-Weight Models Explained
What is an open-weight model?
An AI model whose trained weights are published for anyone to download, so it can be run, tested and fine-tuned on hardware the user controls.
Is an open-weight model the same as open source?
Not always. Open weights means the trained model can be downloaded. Open source usually also means the training code and data are available and the license allows broad reuse. Many open-weight models release the weights only.
Can I use an open-weight model commercially?
It depends on the license. Apache 2.0 and MIT allow commercial use. Other licenses limit it, for example to non-commercial use or below a set number of users. Every model page here shows its license.
How much memory does an open-weight model need?
About two bytes per parameter at 16-bit precision, so a 7-billion-parameter model needs roughly 14 GB for its weights, plus memory for the context it processes. Each model page lists its parameter count and the size of its files.
Related SAVRN Research
The hub sits beside SAVRN's market data and infrastructure research: what models cost to run, and what it takes to run them.
SAVRN Index
What open models cost to run
The same open-weight model priced by every host that serves it, per million tokens.
Research Hub
Data center trackers and maps
Moratoriums, permits, power, water and capital behind the facilities that run these models.
Method
How the Model Hub is built
Sources, evidence labels, refresh behaviour, and the limits of every comparison here.