Every weight in this model was produced by this project. There is no frompretrained, no base checkpoint, and no adapter: the tokenizer, the architecture code, the data pipeline and the training loop are all bespoke, and training started from a random initialisation. Trained on a single RTX 5070 Ti (16 GB). Written by hand — no transformers model classes were used to define it. 309,705,984 transformer blocks. Bits per byte is the headline metric. This model's vocabulary (32,768) differs from GPT-2's (50,257), and cross-entropy per token is not comparable across tokenizers. BPB divides that out and is directly comparable. Validation loss is measured on a held-out slice of the training corpus…
Independent publisher
Dikshan Karwa
Dikshan1234
Models in Library1
Datasets in Library0
Models on Hugging Face7
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Reported licenses: cc-by-nc-4.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.