A 3.3B-parameter decoder-only base language model, pre-trained from scratch with nanochat on one pass over ClimbMix (287B tokens). This is the causal model described in the pre-training section of (PDF). It has had no post-training (no instruction tuning or RLHF), so it continues text rather than following instructions. The same weights load three ways: with transformers (trustremotecode=True), with vLLM (through a small plugin), and with nanochat's own code from the original checkpoint files, which are unchanged. one pass of 287B tokens. The last of its 6,543 shards is held out for validation. Documents are packed into 2,048-token sequences with nanochat's BOS-aligned best-fit packing.…