This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.
Open-weight model · Text generation
ppt-pythia-1b-permuted-seed3408-stage2
by Qing Yao qing-yao/ppt-pythia-1b-permuted-seed3408-stage2
ppt-pythia-1b-permuted-seed3408-stage2 is an open-weight model for text generation from Qing Yao. It has 1B parameters and a 2,048-token context. At 16-bit it needs about 2.4 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.
This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.
Parameters1B
Context2,048
Weights2.0 GB
License—
AccessOpen weights
Monthly Downloads—
Runs On
What it takes to serve ppt-pythia-1b-permuted-seed3408-stage2 (1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 2.0 GB | 2.4 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 1.0 GB | 1.2 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.5 GB | 0.6 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 19, 2026.
Model Card
This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.
Excerpt from the card by Qing Yao.
Configuration
- Architecture
- GPTNeoXForCausalLM
- Context length (tokens)
- 2,048
- Layers
- 16
- Hidden size
- 2,048
- Feed-forward size
- 8,192
- Attention heads
- 8
- Vocabulary size
- 50,304
- RoPE base
- 10,000
- Model type
- gpt_neox
Identity and Version
- Repository
- qing-yao/ppt-pythia-1b-permuted-seed3408-stage2
- Publisher
- Qing Yao
- Task
- Text generation
- Modality
- Text
- Library
- transformers
- Parameters
- 1B parameters
- Languages
- trl, sft
- Revision
- 2d43d4444a9f9e6f752b838469fa1ec8ad48ccdc
- First published
- 2026-09-19
- Last updated
- 2026-09-19
Files and Weights
9 files, 2.0 GB in total. The weights are 2 files totalling 2.0 GB in bin, safetensors.
Weights2 files · 2.0 GB
Configuration3 files · 220.1 KB
Tokenizer2 files · 3.6 MB
Documentation1 file · 1.5 KB
Repository1 file · 1.5 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors | Weights | 2.0 GB | 6e9d7c9fd8c0 |
| training_args.bin | Weights | 6.4 KB | 38139e4e4711 |
| config.json | Configuration | 773 B | — |
| special_tokens_map.json | Configuration | 585 B | — |
| trainer_state.json | Configuration | 218.7 KB | — |
| README.md | Documentation | 1.5 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
| tokenizer.json | Tokenizer | 3.6 MB | — |
| tokenizer_config.json | Tokenizer | 4.9 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 2.0 GB
Download from Qing Yao
Released by Qing Yao through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 2.0 GB |
| 16-bit | 2.0 GB |
| 8-bit | 1.0 GB |
| 4-bit | 0.5 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About ppt-pythia-1b-permuted-seed3408-stage2
How much GPU memory does ppt-pythia-1b-permuted-seed3408-stage2 need?
About 2.4 GB at 16-bit and 0.6 GB at 4-bit: the weights (1B parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run ppt-pythia-1b-permuted-seed3408-stage2 on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
What is ppt-pythia-1b-permuted-seed3408-stage2's context length?
2,048 tokens, from the maximum position embeddings in its published configuration.
Similar Models
This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.
This model is a fine-tuned version of None. It has been trained using TRL. This model was trained with SFT.
My mathematical formulation to utilize space projections to "measure" the Jump between points of discontinuity found in Non-Differentialable Functions. This Model underwent an additional merge between Qemma-redux and Qwen3-14B, in addition to adding Rope Scaling. Fusion Logic was updated to aid per layer fusion and post fusion embedding alignment. Qemma is a HuggingFace-native hybrid model that merges Gemma-3 (1B) and Qwen-3 (14B) at the weight level (no adapters). This variant uses Yarn based Rope Scaling with 1: Ratio from maxpositionembeddings = 524288 Gemma-3 backbone (26 layers, hidden 1152, MLP 6912) Qwen-style attention regrouped to Gemma’s 4×256 heads. (headdim=128, hidden=5120…
My mathematical formulation to utilize space projections to "measure" the Jump between points of discontinuity found in Non-Differentialable Functions. This Model underwent an additional merge between Qemma-redux and Qwen3-1.7B, in addition to adding Rope Scaling. Fusion Logic was updated to aid per layer fusion and post fusion embedding alignment. Qemma is a HuggingFace-native hybrid model that merges Gemma-3 (1B) and Qwen-3 (1.7B) at the weight level (no adapters). This variant uses Yarn based Rope Scaling with 1: Ratio from maxpositionembeddings = 242144 Gemma-3 backbone (26 layers, hidden 1152, MLP 6912) Qwen-style attention regrouped to Gemma’s 4×256 heads. (headdim=128, hidden=2048…
My mathematical formulation to utilize space projections to "measure" the Jump between points of discontinuity found in Non-Differentialable Functions. This Model underwent an additional merge between Qemma-redux and Qwen3-0.6B, in addition to adding Rope Scaling. Fusion Logic was updated to aid per layer fusion and post fusion embedding alignment. Qemma is a HuggingFace-native hybrid model that merges Gemma-3 (1B) and Qwen-3 (0.6B) at the weight level (no adapters). This variant uses Yarn based Rope Scaling with 1:1 Ratio from maxpositionembeddings Use: research, instruction following, code/help, analysis, further SFT/RLHF. Limits: may hallucinate; not for safety-critical, medical, legal…