A 162M-parameter decoder trained twice from the same initialization on the same 2.62 billion FineWeb-Edu tokens, once along each of two different routes through NVIDIA, AMD and Apple GPUs. The two runs are bitwise identical at every one of the 5,000 optimizer steps: training state, summed gradients, all 64 per-shard losses and the learning rate. Their final checkpoint files have the same SHA-256. This repository distributes that one final model with the evidence from both routes. The model is GPT-3 Small-sized and trained with GPT-3 Small's hyperparameters, but its blocks are modern Llama-style blocks; see the comparison below. It is a research artifact for reproducible training, not a…
Independent publisher
Andrew Hendel
ajhendel
Models in Library1
Datasets in Library0
Models on Hugging Face—
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.