Vinay Poduri

VinaySLM is a small language model (SLM) built from scratch in PyTorch to learn how decoder-only Transformers work end to end -- tokenization, embeddings, causal self-attention, training, and generation -- without importing a pretrained architecture. This is not a production-quality language model. - A tiny, hand-written, decoder-only (GPT-style) Transformer. - 466,176 parameters. - Trained on a ~600-token toy corpus of AI/programming sentences. - Packaged here as a custom Hugging Face model (trustremotecode=True) so it can be loaded and inspected through the transformers ecosystem, while the actual Transformer implementation (modelingvinayslm.py) is a thin wrapper around this project's…