28 layers, width 1536, 16 heads, SwiGLU FFN 4096, RoPE, RMSNorm, tied embeddings, context 256. IMPORTANT: Fresh weights trained from scratch on English FineWeb-Edu (language modeling) and Smol-SmolTalk (chat). This model is experimental. A public checkpoint is not a guarantee of fluent answers. Consult trainingstate.json to check its training phase and token counts. Tokenizer: new ByteLevel BPE with 16,000 IDs. Chat prompts use question and responses end in. Training sources: https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu and https://huggingface.co/datasets/HuggingFaceTB/smol-smoltalk. Respect upstream dataset terms. Training uses a single Kaggle GPU and restarts across sessions.…
Independent publisher
Cristian
UncleKhris
Models in Library1
Datasets in Library0
Models on Hugging Face2
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.