This model is a fine-tuned version of fpadovani/arb-arab-100mb-ppt-shuff-dyck-100mbseed10. It has been trained using TRL. This model was trained with SFT.
Open-weight model · Text generation
ivieai_star_v1.0
by George O. Uwaifo GeorgeUwaifo/ivieai_star_v1.0
This model is a fine-tuned version of GeorgeUwaifo/iviegpt2new01cresults on an unknown dataset.
Parameters124M
Context—
Weights497.8 MB
Licensemit
AccessOpen weights
Monthly Downloads—
Runs On
What it takes to serve ivieai_star_v1.0 (124M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 0.2 GB | 0.3 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 0.1 GB | 0.1 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.1 GB | 0.1 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.
Model Card
By George O. Uwaifo, published under mit, revision d016498eca71.
This model is a fine-tuned version of GeorgeUwaifo/iviegpt2new01cresults on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 5e-05 - trainbatchsize: 4 - evalbatchsize: 8 - gradientaccumulationsteps: 4 - totaltrainbatchsize: 16 - lrschedulertype: linear - lrschedulerwarmupsteps: 387 - numepochs: 5 - mixedprecisiontraining: Native AMP - Transformers 5.16.1 - Pytorch 2.11.0+cu128 - Datasets 4.8.5 - Tokenizers 0.23.1
Read George O. Uwaifo's full model card
This model is a fine-tuned version of GeorgeUwaifo/ivie_gpt2_new01c_results on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 2.4562
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 4 - eval_batch_size: 8 - seed: 42 - gradient_accumulation_steps: 4 - total_train_batch_size: 16 - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 387 - num_epochs: 5 - mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| No log | 5.0 | 30 | 2.4562 |
Framework versions
- Transformers 5.16.1
- Pytorch 2.11.0+cu128
- Datasets 4.8.5
- Tokenizers 0.23.1
Configuration
- Architecture
- GPT2LMHeadModel
- Vocabulary size
- 50,257
- Model type
- gpt2
Identity and Version
- Repository
- GeorgeUwaifo/ivieai_star_v1.0
- Publisher
- George O. Uwaifo
- Task
- Text generation
- Modality
- Text
- Library
- transformers
- Parameters
- 124M parameters
- Languages
- Not stated by the source
- Revision
- d016498eca71f84151c1c756f9e176e94dad1d4f
- First published
- 2026-09-18
- Last updated
- 2026-09-18
Files and Weights
8 files, 501.3 MB in total. The weights are 2 files totalling 497.8 MB in bin, safetensors.
Weights2 files · 497.8 MB
Configuration2 files · 1.1 KB
Tokenizer2 files · 3.6 MB
Documentation1 file · 1.6 KB
Repository1 file · 1.5 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors | Weights | 497.8 MB | e12d52fa2870 |
| training_args.bin | Weights | 5.2 KB | 350b2c0ce956 |
| config.json | Configuration | 962 B | — |
| generation_config.json | Configuration | 119 B | — |
| README.md | Documentation | 1.6 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
| tokenizer.json | Tokenizer | 3.6 MB | — |
| tokenizer_config.json | Tokenizer | 326 B | — |
License and Download
- License
- mit
- Access
- Open weights, no gate
- Download size
- 497.8 MB
Download from George O. Uwaifo
Released by George O. Uwaifo through its official repository on Hugging Face. Read the license.
Built From
- Derived from GeorgeUwaifo/ivie_gpt2_new01c_results
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 497.8 MB |
| 16-bit | 0.2 GB |
| 8-bit | 0.1 GB |
| 4-bit | 0.1 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About ivieai_star_v1.0
How much GPU memory does ivieai_star_v1.0 need?
About 0.3 GB at 16-bit and 0.1 GB at 4-bit: the weights (124M parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run ivieai_star_v1.0 on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use ivieai_star_v1.0 commercially?
Yes. ivieai_star_v1.0 is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.
Similar Models
This model is a fine-tuned version of fpadovani/arb-arab-100mb-ppt-Dp-100mbseed10. It has been trained using TRL. This model was trained with SFT.
This model is a fine-tuned version of fpadovani/arb-arab-100mb-ppt-shuff-dyck-10mbseed10. It has been trained using TRL. This model was trained with SFT.
This model is a custom-code derivative of AxiomicLabs/GPT-X2-125M, adapted for experimental long-context causal language modeling and architecture research. The repository includes a Hugging Face Transformers-compatible GPT-X2 implementation with optional Symplectic Metric-RoPE Governor support and training utilities built around CIxOpt, a heterogeneous optimizer developed for efficient parameter routing across large projection matrices, sensitive normalization parameters, and optional governor modules. The model is intended as a research checkpoint for compact long-context generation, positional encoding experiments, optimizer testing, and continued fine-tuning. This implementation uses a…
SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device. More details in our paper: https://arxiv.org/abs/2502.02737 SmolLM2 demonstrates significant advances over its predecessor SmolLM1, particularly in instruction following, knowledge, reasoning. The 135M model was trained on 2 trillion tokens using a diverse dataset combination: FineWeb-Edu, DCLM, The Stack, along with new filtered datasets we curated and will release soon. We developed the instruct version through supervised fine-tuning (SFT) using a combination of public datasets and our…
SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device. More details in our paper https://arxiv.org/abs/2502.02737 SmolLM2 demonstrates significant advances over its predecessor SmolLM1, particularly in instruction following, knowledge, reasoning. The 135M model was trained on 2 trillion tokens using a diverse dataset combination: FineWeb-Edu, DCLM, The Stack, along with new filtered datasets we curated and will release soon. We developed the instruct version through supervised fine-tuning (SFT) using a combination of public datasets and our own…