Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

swa-100mb-after-wc-loglinear-newlex-before-ckpt500-packed-bfdiso_seed3407

by Francesca Padovani francesca9805/swa-100mb-after-wc-loglinear-newlex-before-ckpt500-packed-bfdiso_seed3407

swa-100mb-after-wc-loglinear-newlex-before-ckpt500-packed-bfdiso_seed3407 is an open-weight model for text generation from Francesca Padovani. It has 125M parameters. At 16-bit it needs about 0.3 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.

This model is a fine-tuned version of francesca9805/ppt-wc-loglinear-newlex-swa-before-100mb-packed-bfdisoseed3407. It has been trained using TRL. This model was trained with SFT.

Parameters125M
Context—
Weights3.5 GB
License—
AccessOpen weights
Monthly Downloads—

Runs On

What it takes to serve swa-100mb-after-wc-loglinear-newlex-before-ckpt500-packed-bfdiso_seed3407 (125M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.2 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 18, 2026.

swa-100mb-after-wc-loglinear-newlex-before-ckpt500-packed-bfdiso_seed3407 on every accelerator the SAVRN Index prices, at every precision

Model Card

This model is a fine-tuned version of francesca9805/ppt-wc-loglinear-newlex-swa-before-100mb-packed-bfdisoseed3407. It has been trained using TRL. This model was trained with SFT.

Excerpt from the card by Francesca Padovani.

Configuration

Architecture
GPT2LMHeadModel
Vocabulary size
51,200
Model type
gpt2

Identity and Version

Repository
francesca9805/swa-100mb-after-wc-loglinear-newlex-before-ckpt500-packed-bfdiso_seed3407
Publisher
Francesca Padovani
Task
Text generation
Modality
Text
Library
transformers
Parameters
125M parameters
Languages
trl, sft
Revision
9212ddd307545ade24a55fb1a4a45996dfa35e67
First published
2026-10-11
Last updated
2026-10-11

Files and Weights

139 files, 3.6 GB in total. The weights are 41 files totalling 3.5 GB in bin, pth, safetensors.

Weights41 files · 3.5 GB
Configuration68 files · 62.4 MB
Tokenizer28 files · 18.9 MB
Documentation1 file · 2.0 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
checkpoint-108000/model.safetensorsWeights249.6 MB 6d288f227b7c
checkpoint-108000/rng_state.pthWeights14.6 KB 7c6b6eeba245
checkpoint-108000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-12000/model.safetensorsWeights249.6 MB c9647efdd683
checkpoint-12000/rng_state.pthWeights14.6 KB 8a899c1f5110
checkpoint-12000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-120000/model.safetensorsWeights249.6 MB 9d6937abd69a
checkpoint-120000/rng_state.pthWeights14.6 KB 31dbc3d16295
checkpoint-120000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-132000/model.safetensorsWeights249.6 MB b3ec451a3460
checkpoint-132000/rng_state.pthWeights14.6 KB 23f73b786268
checkpoint-132000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-144000/model.safetensorsWeights249.6 MB 8d5c11f30421
checkpoint-144000/rng_state.pthWeights14.6 KB d71b4093cd8b
checkpoint-144000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-156000/model.safetensorsWeights249.6 MB 4b269dbc37a1
checkpoint-156000/rng_state.pthWeights14.6 KB cc0266cebcda
checkpoint-156000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-24000/model.safetensorsWeights249.6 MB 8451de14cb94
checkpoint-24000/rng_state.pthWeights14.6 KB bf33b056fb44
checkpoint-24000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-36000/model.safetensorsWeights249.6 MB 8b9cd5bc9da6
checkpoint-36000/rng_state.pthWeights14.6 KB e507e36c2090
checkpoint-36000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-48000/model.safetensorsWeights249.6 MB 10a0bc276be3
checkpoint-48000/rng_state.pthWeights14.6 KB 59b7cc5b617d
checkpoint-48000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-60000/model.safetensorsWeights249.6 MB ddd2653ef6fd
checkpoint-60000/rng_state.pthWeights14.6 KB 0831fad13b7c
checkpoint-60000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-72000/model.safetensorsWeights249.6 MB 6df1afcd5b22
checkpoint-72000/rng_state.pthWeights14.6 KB 3e7743fb4ca1
checkpoint-72000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-84000/model.safetensorsWeights249.6 MB 93b139b1670b
checkpoint-84000/rng_state.pthWeights14.6 KB 23dabd1892fd
checkpoint-84000/training_args.binWeights6.4 KB acdf2ee195ca
checkpoint-96000/model.safetensorsWeights249.6 MB 6b88240a634c
checkpoint-96000/rng_state.pthWeights14.6 KB 7a34c3345895
checkpoint-96000/training_args.binWeights6.4 KB acdf2ee195ca
model.safetensorsWeights249.6 MB 4b269dbc37a1
training_args.binWeights6.4 KB acdf2ee195ca
added_tokens.jsonConfiguration27.7 KB —
checkpoint-108000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-108000/config.jsonConfiguration803 B —
checkpoint-108000/generation_config.jsonConfiguration172 B —
checkpoint-108000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-108000/trainer_state.jsonConfiguration6.1 MB —
checkpoint-12000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-12000/config.jsonConfiguration803 B —
checkpoint-12000/generation_config.jsonConfiguration172 B —
checkpoint-12000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-12000/trainer_state.jsonConfiguration674.3 KB —
checkpoint-120000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-120000/config.jsonConfiguration803 B —
checkpoint-120000/generation_config.jsonConfiguration172 B —
checkpoint-120000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-120000/trainer_state.jsonConfiguration6.8 MB —
checkpoint-132000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-132000/config.jsonConfiguration803 B —
checkpoint-132000/generation_config.jsonConfiguration172 B —
checkpoint-132000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-132000/trainer_state.jsonConfiguration7.5 MB —
checkpoint-144000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-144000/config.jsonConfiguration803 B —
checkpoint-144000/generation_config.jsonConfiguration172 B —
checkpoint-144000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-144000/trainer_state.jsonConfiguration8.1 MB —
checkpoint-156000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-156000/config.jsonConfiguration803 B —
checkpoint-156000/generation_config.jsonConfiguration172 B —
checkpoint-156000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-156000/trainer_state.jsonConfiguration8.8 MB —
checkpoint-24000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-24000/config.jsonConfiguration803 B —
checkpoint-24000/generation_config.jsonConfiguration172 B —
checkpoint-24000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-24000/trainer_state.jsonConfiguration1.4 MB —
checkpoint-36000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-36000/config.jsonConfiguration803 B —
checkpoint-36000/generation_config.jsonConfiguration172 B —
checkpoint-36000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-36000/trainer_state.jsonConfiguration2.0 MB —
checkpoint-48000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-48000/config.jsonConfiguration803 B —
checkpoint-48000/generation_config.jsonConfiguration172 B —
checkpoint-48000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-48000/trainer_state.jsonConfiguration2.7 MB —
checkpoint-60000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-60000/config.jsonConfiguration803 B —
checkpoint-60000/generation_config.jsonConfiguration172 B —
checkpoint-60000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-60000/trainer_state.jsonConfiguration3.4 MB —
checkpoint-72000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-72000/config.jsonConfiguration803 B —
checkpoint-72000/generation_config.jsonConfiguration172 B —
checkpoint-72000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-72000/trainer_state.jsonConfiguration4.1 MB —
checkpoint-84000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-84000/config.jsonConfiguration803 B —
checkpoint-84000/generation_config.jsonConfiguration172 B —
checkpoint-84000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-84000/trainer_state.jsonConfiguration4.7 MB —
checkpoint-96000/added_tokens.jsonConfiguration27.7 KB —
checkpoint-96000/config.jsonConfiguration803 B —
checkpoint-96000/generation_config.jsonConfiguration172 B —
checkpoint-96000/special_tokens_map.jsonConfiguration22.6 KB —
checkpoint-96000/trainer_state.jsonConfiguration5.4 MB —
config.jsonConfiguration803 B —
special_tokens_map.jsonConfiguration22.6 KB —
README.mdDocumentation2.0 KB —
.gitattributesRepository1.5 KB —
checkpoint-108000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-108000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-12000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-12000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-120000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-120000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-132000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-132000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-144000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-144000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-156000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-156000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-24000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-24000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-36000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-36000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-48000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-48000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-60000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-60000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-72000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-72000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-84000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-84000/tokenizer_config.jsonTokenizer233.6 KB —
checkpoint-96000/spiece.modelTokenizer1.1 MB 0391325a5092
checkpoint-96000/tokenizer_config.jsonTokenizer233.6 KB —
spiece.modelTokenizer1.1 MB 0391325a5092
tokenizer_config.jsonTokenizer233.6 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
3.5 GB
Download from Francesca Padovani

Released by Francesca Padovani through its official repository on Hugging Face.

Built From

  • Derived from francesca9805/ppt-wc-loglinear-newlex-swa-before-100mb-packed-bfdiso_seed3407

Memory Requirements

PrecisionWeights in memory
As published3.5 GB
16-bit0.2 GB
8-bit0.1 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About swa-100mb-after-wc-loglinear-newlex-before-ckpt500-packed-bfdiso_seed3407

How much GPU memory does swa-100mb-after-wc-loglinear-newlex-before-ckpt500-packed-bfdiso_seed3407 need?

About 0.3 GB at 16-bit and 0.1 GB at 4-bit: the weights (125M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run swa-100mb-after-wc-loglinear-newlex-before-ckpt500-packed-bfdiso_seed3407 on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Similar Models