Sanskrit-322M-Base is a 322-million-parameter Sanskrit language model trained from scratch with its own 32,000-token SentencePiece Unigram tokenizer. It is intended for Sanskrit text completion, generation experiments, and further task-specific fine-tuning. This is a base pretrained model: it predicts the continuation of text. It has not been instruction-tuned or trained as a conversational assistant. It uses a Llama-compatible decoder architecture; its weights were initialized and trained independently, rather than adapted from a pretrained Llama checkpoint. Published by sraivante under the Apache License 2.0. The tokenizer uses identity normalization, byte fallback, and SentencePiece…
Open-weight model · Text generation
gpt2-300m-climbmix-pretrain
by Solhost solhost/gpt2-300m-climbmix-pretrain
gpt2-300m-climbmix-pretrain is a model for text generation from Solhost (access requested at publisher). It has 303M parameters. At 16-bit it needs about 0.7 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.
Runs On
What it takes to serve gpt2-300m-climbmix-pretrain (303M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 0.6 GB | 0.7 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 0.3 GB | 0.4 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 0.2 GB | 0.2 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 24, 2026.
gpt2-300m-climbmix-pretrain on every accelerator the SAVRN Index prices, at every precision
Model Card
Identity and Version
- Repository
- solhost/gpt2-300m-climbmix-pretrain
- Publisher
- Solhost
- Task
- Text generation
- Modality
- Text
- Library
- pytorch
- Parameters
- 303M parameters
- Languages
- en
- Revision
- 145ee48417d1a9d8eaa7df49bbdce005291dd1a0
- First published
- 2026-10-16
- Last updated
- 2026-10-22
License and Download
- License
- Not stated by the source
- Access
- Access requested at publisher
Solhost grants access through its official repository on Hugging Face.
Built From
- Trained on (disclosed) nvidia/Nemotron-ClimbMix
Memory Requirements
| Precision | Weights in memory |
|---|---|
| 16-bit | 0.6 GB |
| 8-bit | 0.3 GB |
| 4-bit | 0.2 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About gpt2-300m-climbmix-pretrain
How much GPU memory does gpt2-300m-climbmix-pretrain need?
About 0.7 GB at 16-bit and 0.2 GB at 4-bit: the weights (303M parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run gpt2-300m-climbmix-pretrain on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Similar Models
English | MiniCPM5-2B-DSpark is a DSpark draft checkpoint trained for exact pairing with MiniCPM5-2B and its tokenizer. Training responses were generated by MiniCPM5-2B from a mixture of general-domain, mathematics, and code prompts. Acceptance length is defined as the total number of completion tokens divided by the total number of speculative verification steps. Evaluation uses natural EOS termination and maxnewtokens=4096. This model has no autonomous intent or legal personhood; its outputs are text generated from statistical patterns and may be inaccurate, biased, or offensive, and may be manipulated by carefully crafted prompts ("jailbreaks") into producing unintended content. Its…
Results on demo model (different generation method, one model per language): Keywords generated with vlT5-base-keywords: encoder-decoder architecture, vlT5, keyword generation, scientific articles corpus The biggest advantage is the transferability of the vlT5 model, as it works well on all domains and types of text. The downside is that the text length and the number of keywords are similar to the training data: the text piece of an abstract length generates approximately 3 to 5 keywords. It works both extractive and abstractively. Longer pieces of text must be split into smaller chunks, and then propagated to the model. The model was trained on a POSMAC corpus. Polish Open Science…
This model is a fine-tuned derivative of google/gemma-3-270m, adapted using the Convergent Intelligence sparse fine-tuning setup originally tested on Liquid Foundation Models. The checkpoint was trained on reasoning-style English examples from angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k using a targeted adaptation strategy and the custom CIxOpt optimizer framework. The goal of this model is to test whether a compact Gemma 3 270M backbone can be shaped toward reasoning-style text generation through selective parameter participation rather than broad full-model modification. This is an experimental research checkpoint intended for evaluation, local testing, optimizer research, and…
This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).
The on-device storyteller for Outward, an offline walking adventure. You go outside, find something real ("rainwater running down a drain"), and this model writes the next 60–120 words of the story around it. It runs entirely on the phone, in the browser, with llama.cpp (wllama). Modified by the Outward project. This is a Model Derivative of google/gemma-3-270m-it: fully fine-tuned on 3,186 stories written by a LoRA fine-tuned Qwen3.5-4B teacher (trained on Tinker), then converted to GGUF and quantized to Q40. The eval set has 50 held-out prompts × 3 samples, temperature 0.7, scored with the automatic rubric in the Outward repo: uses the discovery, 60–120 words, safe and outdoors (risky…