Open-weight model
ppt-pythia-1b-iid500-current_ce-seed1024-stage2
by Qing Yao qing-yao/ppt-pythia-1b-iid500-current_ce-seed1024-stage2
ppt-pythia-1b-iid500-current_ce-seed1024-stage2 is an open-weight model from Qing Yao. It has 1B parameters and a 2,048-token context. At 16-bit it needs about 2.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.
Parameters1B
Context2,048
Weights46.5 GB
License—
AccessOpen weights
Monthly Downloads—
Runs On
What it takes to serve ppt-pythia-1b-iid500-current_ce-seed1024-stage2 (1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 2.0 GB | 2.4 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 1.0 GB | 1.2 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.5 GB | 0.6 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 19, 2026.
Model Card
The publisher has not written a card for this model.
Configuration
- Architecture
- GPTNeoXForCausalLM
- Context length (tokens)
- 2,048
- Layers
- 16
- Hidden size
- 2,048
- Feed-forward size
- 8,192
- Attention heads
- 8
- Vocabulary size
- 50,304
- Model type
- gpt_neox
Identity and Version
- Repository
- qing-yao/ppt-pythia-1b-iid500-current_ce-seed1024-stage2
- Publisher
- Qing Yao
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- 1B parameters
- Languages
- Not stated by the source
- Revision
- a23eb8393aab4714d2d20cb11a6b2db23fb52fc5
- First published
- 2026-10-11
- Last updated
- 2026-10-12
Files and Weights
162 files, 46.6 GB in total. The weights are 23 files totalling 46.5 GB in safetensors.
Weights23 files · 46.5 GB
Configuration92 files · 1.7 MB
Tokenizer46 files · 82.0 MB
Repository1 file · 1.5 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| checkpoint-0/model.safetensors | Weights | 2.0 GB | 6067958b3ff8 |
| checkpoint-100/model.safetensors | Weights | 2.0 GB | 08f514e707fe |
| checkpoint-10000/model.safetensors | Weights | 2.0 GB | c72708010375 |
| checkpoint-1200/model.safetensors | Weights | 2.0 GB | 97c114e5acd5 |
| checkpoint-12000/model.safetensors | Weights | 2.0 GB | 0517b4b6a342 |
| checkpoint-14000/model.safetensors | Weights | 2.0 GB | 1d4a6176c105 |
| checkpoint-1600/model.safetensors | Weights | 2.0 GB | b8e404f527d4 |
| checkpoint-16000/model.safetensors | Weights | 2.0 GB | ed2090989708 |
| checkpoint-18000/model.safetensors | Weights | 2.0 GB | 12e4790e6921 |
| checkpoint-200/model.safetensors | Weights | 2.0 GB | 8387e4064635 |
| checkpoint-2000/model.safetensors | Weights | 2.0 GB | 763b366fd717 |
| checkpoint-20000/model.safetensors | Weights | 2.0 GB | 180befad0271 |
| checkpoint-22000/model.safetensors | Weights | 2.0 GB | c3eff7d1d56a |
| checkpoint-24000/model.safetensors | Weights | 2.0 GB | 5c8d4884c27a |
| checkpoint-25/model.safetensors | Weights | 2.0 GB | 4835f14a4bfd |
| checkpoint-25000/model.safetensors | Weights | 2.0 GB | 2a2bd7882b20 |
| checkpoint-400/model.safetensors | Weights | 2.0 GB | 8e7a9e945a2f |
| checkpoint-4000/model.safetensors | Weights | 2.0 GB | 5a86fd3e39d5 |
| checkpoint-50/model.safetensors | Weights | 2.0 GB | 45b198db792a |
| checkpoint-6000/model.safetensors | Weights | 2.0 GB | 15e5562ab467 |
| checkpoint-800/model.safetensors | Weights | 2.0 GB | 1506bed955cd |
| checkpoint-8000/model.safetensors | Weights | 2.0 GB | 0a19fa5e07aa |
| model.safetensors | Weights | 2.0 GB | 2a2bd7882b20 |
| checkpoint-0/config.json | Configuration | 781 B | — |
| checkpoint-0/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-0/generation_config.json | Configuration | 225 B | — |
| checkpoint-0/trainer_state.json | Configuration | 750 B | — |
| checkpoint-100/config.json | Configuration | 781 B | — |
| checkpoint-100/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-100/generation_config.json | Configuration | 225 B | — |
| checkpoint-100/trainer_state.json | Configuration | 2.2 KB | — |
| checkpoint-10000/config.json | Configuration | 781 B | — |
| checkpoint-10000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-10000/generation_config.json | Configuration | 225 B | — |
| checkpoint-10000/trainer_state.json | Configuration | 73.6 KB | — |
| checkpoint-1200/config.json | Configuration | 781 B | — |
| checkpoint-1200/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-1200/generation_config.json | Configuration | 225 B | — |
| checkpoint-1200/trainer_state.json | Configuration | 10.0 KB | — |
| checkpoint-12000/config.json | Configuration | 781 B | — |
| checkpoint-12000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-12000/generation_config.json | Configuration | 225 B | — |
| checkpoint-12000/trainer_state.json | Configuration | 88.1 KB | — |
| checkpoint-14000/config.json | Configuration | 781 B | — |
| checkpoint-14000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-14000/generation_config.json | Configuration | 225 B | — |
| checkpoint-14000/trainer_state.json | Configuration | 102.6 KB | — |
| checkpoint-1600/config.json | Configuration | 781 B | — |
| checkpoint-1600/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-1600/generation_config.json | Configuration | 225 B | — |
| checkpoint-1600/trainer_state.json | Configuration | 12.9 KB | — |
| checkpoint-16000/config.json | Configuration | 781 B | — |
| checkpoint-16000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-16000/generation_config.json | Configuration | 225 B | — |
| checkpoint-16000/trainer_state.json | Configuration | 117.2 KB | — |
| checkpoint-18000/config.json | Configuration | 781 B | — |
| checkpoint-18000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-18000/generation_config.json | Configuration | 225 B | — |
| checkpoint-18000/trainer_state.json | Configuration | 131.8 KB | — |
| checkpoint-200/config.json | Configuration | 781 B | — |
| checkpoint-200/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-200/generation_config.json | Configuration | 225 B | — |
| checkpoint-200/trainer_state.json | Configuration | 2.9 KB | — |
| checkpoint-2000/config.json | Configuration | 781 B | — |
| checkpoint-2000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-2000/generation_config.json | Configuration | 225 B | — |
| checkpoint-2000/trainer_state.json | Configuration | 15.7 KB | — |
| checkpoint-20000/config.json | Configuration | 781 B | — |
| checkpoint-20000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-20000/generation_config.json | Configuration | 225 B | — |
| checkpoint-20000/trainer_state.json | Configuration | 146.2 KB | — |
| checkpoint-22000/config.json | Configuration | 781 B | — |
| checkpoint-22000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-22000/generation_config.json | Configuration | 225 B | — |
| checkpoint-22000/trainer_state.json | Configuration | 160.8 KB | — |
| checkpoint-24000/config.json | Configuration | 781 B | — |
| checkpoint-24000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-24000/generation_config.json | Configuration | 225 B | — |
| checkpoint-24000/trainer_state.json | Configuration | 175.3 KB | — |
| checkpoint-25/config.json | Configuration | 781 B | — |
| checkpoint-25/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-25/generation_config.json | Configuration | 225 B | — |
| checkpoint-25/trainer_state.json | Configuration | 1.5 KB | — |
| checkpoint-25000/config.json | Configuration | 781 B | — |
| checkpoint-25000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-25000/generation_config.json | Configuration | 225 B | — |
| checkpoint-25000/trainer_state.json | Configuration | 182.5 KB | — |
| checkpoint-400/config.json | Configuration | 781 B | — |
| checkpoint-400/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-400/generation_config.json | Configuration | 225 B | — |
| checkpoint-400/trainer_state.json | Configuration | 4.3 KB | — |
| checkpoint-4000/config.json | Configuration | 781 B | — |
| checkpoint-4000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-4000/generation_config.json | Configuration | 225 B | — |
| checkpoint-4000/trainer_state.json | Configuration | 30.1 KB | — |
| checkpoint-50/config.json | Configuration | 781 B | — |
| checkpoint-50/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-50/generation_config.json | Configuration | 225 B | — |
| checkpoint-50/trainer_state.json | Configuration | 1.8 KB | — |
| checkpoint-6000/config.json | Configuration | 781 B | — |
| checkpoint-6000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-6000/generation_config.json | Configuration | 225 B | — |
| checkpoint-6000/trainer_state.json | Configuration | 44.6 KB | — |
| checkpoint-800/config.json | Configuration | 781 B | — |
| checkpoint-800/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-800/generation_config.json | Configuration | 225 B | — |
| checkpoint-800/trainer_state.json | Configuration | 7.1 KB | — |
| checkpoint-8000/config.json | Configuration | 781 B | — |
| checkpoint-8000/experiment.json | Configuration | 5.6 KB | — |
| checkpoint-8000/generation_config.json | Configuration | 225 B | — |
| checkpoint-8000/trainer_state.json | Configuration | 59.1 KB | — |
| config.json | Configuration | 781 B | — |
| experiment.json | Configuration | 5.6 KB | — |
| generation_config.json | Configuration | 225 B | — |
| trainer_state.json | Configuration | 182.7 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
| checkpoint-0/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-0/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-100/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-100/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-10000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-10000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-1200/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-1200/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-12000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-12000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-14000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-14000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-1600/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-1600/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-16000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-16000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-18000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-18000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-200/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-200/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-2000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-2000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-20000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-20000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-22000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-22000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-24000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-24000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-25/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-25/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-25000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-25000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-400/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-400/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-4000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-4000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-50/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-50/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-6000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-6000/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-800/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-800/tokenizer_config.json | Tokenizer | 349 B | — |
| checkpoint-8000/tokenizer.json | Tokenizer | 3.6 MB | — |
| checkpoint-8000/tokenizer_config.json | Tokenizer | 349 B | — |
| tokenizer.json | Tokenizer | 3.6 MB | — |
| tokenizer_config.json | Tokenizer | 349 B | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 46.5 GB
Download from Qing Yao
Released by Qing Yao through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 46.5 GB |
| 16-bit | 2.0 GB |
| 8-bit | 1.0 GB |
| 4-bit | 0.5 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About ppt-pythia-1b-iid500-current_ce-seed1024-stage2
How much GPU memory does ppt-pythia-1b-iid500-current_ce-seed1024-stage2 need?
About 2.4 GB at 16-bit and 0.6 GB at 4-bit: the weights (1B parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run ppt-pythia-1b-iid500-current_ce-seed1024-stage2 on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
What is ppt-pythia-1b-iid500-current_ce-seed1024-stage2's context length?
2,048 tokens, from the maximum position embeddings in its published configuration.