SAVRN
Search Contact SAVRN

Open-weight model · Text generation

SmolLM2-135M-Instruct

by Hugging Face Smol Models Research HuggingFaceTB/SmolLM2-135M-Instruct

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device.

Parameters135M
Context8,192
Weights2.0 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads1.5M

Runs On

What it takes to serve SmolLM2-135M-Instruct (135M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.3 GB 0.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on SmolLM2-135M-Instruct

We keep a slot in every facility for very small text models, and SmolLM2-135M-Instruct from Hugging Face Smol Models Research is the kind that fills it. At 135 million parameters and 0.3 GB of memory at 16-bit, it fits on any device, and the cheapest Index host, one MI300X with 192 GB at $1.85 an hour on-demand, would hold hundreds of instances. Its work is on-device text generation: short instructions, classification, routing, the traffic you do not send to a large model. Context is 8,192 tokens, enough for a page, not a contract.

Apache 2.0 allows commercial use, and our record shows it derived from and quantized from the SmolLM2-135M base, described in arXiv:2502.02737. Before deploying, confirm the base model's terms travel with it, match the September 22, 2025 update to the version you pulled, and note the onnx export for CPU serving.

Model Card

By Hugging Face Smol Models Research, published under apache-2.0, revision 12fd25f77366.

SmolLM2

Table of Contents

  1. Model Summary
  2. Limitations
  3. Training
  4. License
  5. Citation

Model Summary

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device. More details in our paper https://arxiv.org/abs/2502.02737

SmolLM2 demonstrates significant advances over its predecessor SmolLM1, particularly in instruction following, knowledge, reasoning. The 135M model was trained on 2 trillion tokens using a diverse dataset combination: FineWeb-Edu, DCLM, The Stack, along with new filtered datasets we curated and will release soon. We developed the instruct version through supervised fine-tuning (SFT) using a combination of public datasets and our own curated datasets. We then applied Direct Preference Optimization (DPO) using UltraFeedback.

Read the full model card (610 words)

Configuration

Architecture
LlamaForCausalLM
Context length (tokens)
8,192
Layers
30
Hidden size
576
Feed-forward size
1,536
Attention heads
9
Key/value heads
3
Vocabulary size
49,152
RoPE base
100,000
Stored precision
bfloat16
Model type
llama

Identity and Version

Repository
HuggingFaceTB/SmolLM2-135M-Instruct
Publisher
Hugging Face Smol Models Research
Task
Text generation
Modality
Text
Library
transformers
Parameters
135M parameters
Languages
en
Revision
12fd25f77366fa6b3b4b768ec3050bf629380bac
First published
2024-10-31
Last updated
2025-09-22

Files and Weights

25 files, 2.0 GB in total. The weights are 10 files totalling 2.0 GB in bin, onnx, safetensors.

Weights10 files · 2.0 GB
Configuration7 files · 60.5 KB
Tokenizer4 files · 3.4 MB
Documentation1 file · 6.8 KB
Other2 files · 79.0 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights269.1 MB 5af571cbf074
onnx/model.onnxWeights540.3 MB 1e790f1d6fac
onnx/model_bnb4.onnxWeights175.4 MB bc32b446540f
onnx/model_fp16.onnxWeights270.3 MB e85e706ce14a
onnx/model_int8.onnxWeights137.1 MB a7c33f9ef85d
onnx/model_q4.onnxWeights182.1 MB 933577110303
onnx/model_q4f16.onnxWeights117.7 MB 9358cd4ce037
onnx/model_quantized.onnxWeights137.1 MB ecc1a19eece6
onnx/model_uint8.onnxWeights137.1 MB ecc1a19eece6
training_args.binWeights6.5 KB 90f508e5769b
all_results.jsonConfiguration783 B
config.jsonConfiguration861 B
eval_results.jsonConfiguration586 B
generation_config.jsonConfiguration132 B
special_tokens_map.jsonConfiguration655 B
train_results.jsonConfiguration232 B
trainer_state.jsonConfiguration57.2 KB
README.mdDocumentation6.8 KB
runs/Oct31_10-14-22_ip-26-0-174-36/events.out.tfevents.1730370128.ip-26-0-174-36.3239327.0Other78.2 KB 774faae98f36
runs/Oct31_10-14-22_ip-26-0-174-36/events.out.tfevents.1730376056.ip-26-0-174-36.3239327.1Other828 B 043a35029ecb
.gitattributesRepository1.5 KB
merges.txtTokenizer466.4 KB
tokenizer.jsonTokenizer2.1 MB
tokenizer_config.jsonTokenizer3.8 KB
vocab.jsonTokenizer800.7 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
2.0 GB
Download from Hugging Face Smol Models Research

Released by Hugging Face Smol Models Research through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published2.0 GB
16-bit0.3 GB
8-bit0.1 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Compare SmolLM2-135M-Instruct

Questions About SmolLM2-135M-Instruct

How much GPU memory does SmolLM2-135M-Instruct need?

About 0.3 GB at 16-bit and 0.1 GB at 4-bit: the weights (135M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run SmolLM2-135M-Instruct on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use SmolLM2-135M-Instruct commercially?

Yes. SmolLM2-135M-Instruct is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is SmolLM2-135M-Instruct's context length?

8,192 tokens, from the maximum position embeddings in its published configuration.

Similar Models

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device. More details in our paper: https://arxiv.org/abs/2502.02737 SmolLM2 demonstrates significant advances over its predecessor SmolLM1, particularly in instruction following, knowledge, reasoning. The 135M model was trained on 2 trillion tokens using a diverse dataset combination: FineWeb-Edu, DCLM, The Stack, along with new filtered datasets we curated and will release soon. We developed the instruct version through supervised fine-tuning (SFT) using a combination of public datasets and our…

Open weights apache-2.0 135M parameters 8,192 tokens transformers

Model · Text generation

gpt2

OpenAI community

Test the whole generation capabilities here: https://transformer.huggingface.co/doc/gpt2-large Pretrained model on English language using a causal language modeling (CLM) objective. It was introduced in and first released at this page. model. Content from this model card has been written by the Hugging Face team to complete the information they provided and give specific examples of bias. GPT-2 is a transformers model pretrained on a very large corpus of English data in a self-supervised fashion. This means it was pretrained on the raw texts only, with no humans labelling them in any way (which is why it can use lots of publicly available data) with an automatic process to generate inputs…

Open weights mit 137M parameters transformers

This model is a custom-code derivative of AxiomicLabs/GPT-X2-125M, adapted for experimental long-context causal language modeling and architecture research. The repository includes a Hugging Face Transformers-compatible GPT-X2 implementation with optional Symplectic Metric-RoPE Governor support and training utilities built around CIxOpt, a heterogeneous optimizer developed for efficient parameter routing across large projection matrices, sensitive normalization parameters, and optional governor modules. The model is intended as a research checkpoint for compact long-context generation, positional encoding experiments, optimizer testing, and continued fine-tuning. This implementation uses a…

Open weights apache-2.0 126M parameters 32,768 tokens transformers

Model · Text generation

Haidass-Translate-143M

DALab

English | 中文 A 143M-parameter bidirectional Chinese↔English translation model, instruction-tuned on the Haidass1.5-143M base — the strongest zh⇄en translator at this scale among general chat-architecture models. Drafter-143M: a control model with identical configuration, data and training recipe, except that it starts from random initialization instead of the pretrained base — used to quantify the contribution of base-model pretraining. OPUS-MT models are single-directional — one independent 78M model per direction; "-" marks directions a model does not serve. The same models re-evaluated on FLORES+ devtest (released 2026; zero overlap with dev): devtest sentences do not overlap with dev.…

Open weights apache-2.0 143M parameters 4,096 tokens

English | 中文 The instruction-tolerant sibling of DALabCommunity/Haidass-Translate-143M: same 143M zh⇄en translation training, plus 9.1% cleaned general-domain data (STEPFUN ShareGPT) mixed in. Translation scores are within 0.3 BLEU of the pure-translation version, and the model retains limited general instruction-following ability that the pure-translation version does not have. Drafter-143M: a control model with identical configuration, data and training recipe, except that it starts from random initialization instead of the pretrained base — used to quantify the contribution of base-model pretraining. OPUS-MT models are single-directional — one independent 78M model per direction; "-"…

Open weights apache-2.0 143M parameters 4,096 tokens