Skip to page content
SAVRN
Search Plan a project

Open-weight model · Image and text to text

Inkling-Small

by Thinking Machines Lab thinkingmachines/Inkling-Small

Inkling-Small is an open-weight model for image and text to text from Thinking Machines Lab, released under Apache License 2.0. It has 266B parameters. At 16-bit it needs about 638.3 GB of GPU memory, which fits on 3x MI325X from $6.00 an hour; at 4-bit, 159.6 GB on 1x MI300X from $1.85, at the lowest prices in the SAVRN Index. It draws 1M downloads a month.

Inkling-Small is a general-purpose multimodal model that accepts text, image and audio inputs and generates text outputs. It is intended for use in English and other languages, and across multiple coding languages.

Parameters266B
Context—
Weights531.9 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads1M

Runs On

What it takes to serve Inkling-Small (266B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 531.9 GB 638.3 GB 3x MI325X (256 GB)
Vultr
$6.00 4x MI300X $7.40 · 3x MI355X $7.77
8-bit 266.0 GB 319.1 GB 2x MI300X (192 GB)
Vultr
$3.70 2x MI325X $4.00 · 2x MI355X $5.18
4-bit 133.0 GB 159.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x MI325X $2.00 · 1x MI355X $2.59

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 27, 2026.

Inkling-Small on every accelerator the SAVRN Index prices, at every precision

Model Card

By Thinking Machines Lab, published under apache-2.0, revision 8cc5877b44d3.

Inkling-Small is a general-purpose multimodal model that accepts text, image and audio inputs and generates text outputs. It is intended for use in English and other languages, and across multiple coding languages. The model is designed to be used by developers building AI-powered applications, including agentic and tool-use systems, coding assistants, chatbots, and retrieval-augmented generation systems, and is suitable for general-purpose conversational use, instruction-following, and other natural language and multimodal tasks. It is released with open weights to support research, fine-tuning and integration into third-party products by downstream developers. Languages: English, with…

Read Thinking Machines Lab's full model card

Inkling

BF16 | NVFP4 | Playground | Tinker Cookbook | Acceptable Use

1. General Information

Inkling-Small is a general-purpose multimodal model that accepts text, image and audio inputs and generates text outputs. It is intended for use in English and other languages, and across multiple coding languages. The model is designed to be used by developers building AI-powered applications, including agentic and tool-use systems, coding assistants, chatbots, and retrieval-augmented generation systems, and is suitable for general-purpose conversational use, instruction-following, and other natural language and multimodal tasks. It is released with open weights to support research, fine-tuning and integration into third-party products by downstream developers.

Languages: English, with general multilingual capabilities across other languages.

2. Getting Started

Try Inkling-Small on the Tinker Playground or access via API using the Tinker Cookbook.

Inkling-Small supports local deployment using the following open-source libraries:

API access is also available through third party inference providers.

3. Model Properties

Model type

Multimodal autoregressive transformer

Architecture type

A 42-layer decoder-only transformer with a sparse Mixture-of-Experts (MoE) feed-forward backbone: each token is routed to 6 of 256 experts, plus 2 shared experts active on every token. Attention is a hybrid of local and global layers. The model is natively multimodal — images are encoded via a hierarchical patch encoder, and audio via discrete token encoding — with all modalities projected into a shared hidden space and processed jointly by the decoder.

Parameters

276B total, 12B active

Numerics support

BF16 and NVFP4

Input modalities

Inkling-Small accepts text, image, and audio inputs:

  • Text: UTF-8 encoded text
  • Image: Any pixel-based image input. For optimal performance, each image dimension should be between 40px to 4096px.
  • Audio: WAV format, sampled at 16kHz. For optimal performance, audio length should ideally be under 2 mins.

Output modalities

Inkling-Small generates output as UTF-8 encoded text.

4. Training

Training data includes a broad variety of content types, including text, images, audio, video.

Training data for the model was drawn from publicly available sources, acquired from third-parties, or synthetically generated or augmented. Publicly available data includes content from the public internet and publicly accessible repositories.

The training data curation process includes cleaning, processing, and modifying datasets. These processing steps, which vary by data type, may include deduplication and filtering to remove junk or other low-quality data, or to advance safety or other objectives.

5. Evaluations

Open weights Closed weights
Inkling-Small Qwen3.5 397B-A17B MiMo V2.5 Minimax M2.7 DeepSeek V4 Flash Nemotron 3 Ultra Inkling Claude 4.5 Haiku Gemini 3.5 Flash-Lite GPT 5.6 Luna
Model Info
AA Index (v4.1) 40.0% 34.0% 37.0% 38.0% 40.0% 38.0% 41.0% 30.0% 36.0% 49.0%
Params (B) (activated / total) 12 / 276 17 / 397 15 / 310 10 / 230 13 / 284 55 / 550 41 / 975 – – –
Agentic (coding)
SWEBench Verified 80.2% 76.4% 71.0% 79.9% 79.0% 70.7% 77.6% 73.3% 75.0% 93.0%
SWEBench Pro (public) 55.9% 50.9% 56.1% 56.2% 52.6% 46.4% 54.3% 39.5% 54.2% 62.7%
Terminal Bench 2.1 (best harness) 64.7% 51.3% 63.7% 55.4% 61.8% 56.4% 63.8% 44.2% 54.0% 82.5%
SciCode 48.7% 42.0% 43.1% 47.0% 44.9% 39.9% 46.1% 43.3% 40.9% 50.0%
Agentic (general)
GDPval-AA v2 1269 962 1145 1159 1189 1164 1238 911 1139 1530
MCP Atlas (public / all) 79.6/79.2% 74.2%/– – 49.4%/– 69.0%/– 47.4/44.7% 78.8/76.0% 41.2/40.2% 79.8/76.8% 77.0/75.0%
Tau 3 Banking 15.5% 13.4% 6.6% 8.9% 22.9% 13.8% 23.7% 9.1% 16.5% 24.3%
BrowseComp (with context management) 77.4% 78.6% – 76.3% 73.2% 63.0% 77.1% – – 84.0%
Toolathlon Verified 54.4% 40.7% 49.1% 47.5% 50.9% 34.3% 45.5% 26.9% 57.1% 67.9%
AA-Briefcase 917 – – – 833 870 839 612 – –
Reasoning (general)
GPQA Diamond 89.5% 89.3% 84.9% 87.4% 89.4% 86.7% 87.2% 67.2% 83.8% 89.5%
HLE (text only) 31.6% 27.3% 25.2% 28.1% 32.1% 26.6% 29.7% 9.7% 17.5% 35.6%
HLE (with tools) 47.8% 48.3% 40.0% 40.3% 45.1% 37.4% 46.0% 17.8% 42.5% 48.9%
AIME 2026 95.5% 93.3% 93.6% 87.7% 95.8% 94.2% 97.1% 85.1% 82.2% 97.6%
HMMT Feb 2026 90.2% 87.9% 82.6% 71.2% 93.9% 78.8% 86.3% 66.7% 63.6% 98.5%
CritPt 8.3% 1.7% 3.7% 0.6% 7.1% 3.1% 5.4% 0.0% 0.0% 20.6%
Reasoning (abstract)
ARC-AGI-1 84.0% – – – – – 79.5% 47.7% – 87.7%
ARC-AGI-2 40.1% – – – – – 36.5% 4.0% – 47.6%
Factuality
SimpleQA Verified 20.6% 26.0% 16.1% 13.5% 34.1% 32.4% 43.9% 5.9% 44.1% 41.7%
AA Omniscience (index) -9.0 -29.8 -9.3 0.7 -22.9 -1.0 2.1 -4.2 6.9 -11.6
Chat
IFBench 82.2% 78.8% 67.1% 75.7% 79.2% 81.4% 79.8% 54.3% 78.6% 67.3%
Global-MMLU-Lite 86.7% 90.0% 83.5% 83.9% 88.4% 85.6% 88.7% 83.4% 89.4% 88.7%
Safety
StrongREJECT 98.4% 99.4% 99.3% 99.4% 97.4% 98.7% 98.6% 98.6% 97.6% 98.7%
FORTRESS (adversarial) 71.6% 77.3% 64.8% 86.3% 32.0% 77.6% 78.0% 91.3% 70.7% 83.8%
FORTRESS (benign) 96.9% 95.4% 94.6% 90.1% 99.2% 90.6% 95.9% 94.1% 95.5% 97.8%
Vision
MMMU Pro (Standard 10) 74.0% 77.3% 75.4% – – – 73.5% 58.6% 79.0% 78.6%
Charxiv RQ (original / with python) 77.4/81.3% 80.8%/– 81.0%/– – – – 78.1/82.0% 57.4%/– 70.0%/– 81.4%/–
Audio
Audio MC 54.9% – 30.4% – – – 56.6% – 33.6% –
MMAU 77.0% – 73.6% – – – 77.2% – 75.2% –
VoiceBench 90.1% – 86.4% – – – 91.4% – 85.9% –
  • Inkling-Small against open-and closed-weights models across the full eval suite. Activated and total parameters are given for scale; a dash means the score was not available at the time of writing.
  • SWEBench Verified: Inkling and Inkling-Small’s numbers are reported using a bash-only harness. We use self-reported numbers for external models.
  • Terminal Bench 2.1: Inkling and Inkling-Small’s numbers are reported using an internal coding harness. A small number of solutions were found to be contaminated from web search and were assigned a score of 0. We use self-reported numbers for external models where available. Otherwise, we report performance using our internal harness.
  • Audio MC: Other models were evaluated internally since they are not on the official leaderboard.
  • VoiceBench: VoiceBench uses rule-based, hard-coded string matching for grading, making the evaluation sensitive to output-formatting differences. We therefore added a system message instructing models to follow the expected answer format.
  • HLE with tools: We benchmarked Minimax M2.7, Claude 4.5 Haiku, Gemini 3.5 Flash-Lite, and GPT 5.6 Luna using our internal harness.

6. Safety

We conducted safety evaluations ahead of release, spanning both everyday human-AI interaction and dangerous-capability testing. Because Inkling-Small is multimodal, we paid attention to whether safety behavior held consistently across text, audio, and image inputs. We applied mitigations to reduce risks before release.

For everyday interaction, we evaluated sycophancy, harmful manipulation, and psychological-harm patterns like parasocial dependency and validation of delusional reasoning, including through multi-turn, open-ended external red-teaming designed to surface issues that only emerge over longer conversations. We also assessed whether the model refuses genuinely harmful requests without over-refusing benign ones. For CBRN and cyber, we assessed knowledge and procedural uplift through internal evaluations, external testing, and refusal-suppressed variants intended to estimate latent capability with safeguards removed. For loss of control, we evaluated agentic capability, strategic deception, and sabotage potential, benchmarked against public frontier models, and found the model materially below frontier capabilities.

Across all areas, we concluded that Inkling-Small did not present risk of material uplift beyond what's already available in the open-weight ecosystem.

The residual risks identified in our evaluations — specifically, Inkling-Small’s occasional tendency to comply with role-play and indirectly framed prompts concerning harmful topics — are consistent with what you would see from any open-weight model, and are best addressed with defense-in-depth rather than relying on the model's refusals alone. Common downstream moderation tools, such as Llama Guard, are compatible with Inkling-Small and can be layered around the model to catch jailbreak attempts, filter unsafe outputs, and enforce use-case-specific policies. We would encourage treating this kind of input/output classification as a part of your deployment stack, especially for consumer-facing or high-traffic applications where adversarial prompting is more likely.

7. Bias, risks and limitations

Inkling-Small may exhibit general limitations common to foundation models, including hallucination (generating plausible but factually incorrect or unsupported content), occasional failures to follow instructions precisely, and degraded performance in long multi-turn conversations. As with other large-scale models trained on web-derived and synthetic data, Inkling-Small may reflect biases present in its training data, including demographic, cultural, or linguistic biases, and may perform unevenly across languages, dialects, or subject domains that were less represented during training.

Inkling-Small's knowledge is limited to information available as of its training cutoff, and it may not reflect events, developments, or changes that occurred afterward.

We recommend that downstream developers and deployers apply appropriate human oversight and review for outputs used in high-stakes or safety-critical contexts, rather than relying on Inkling-Small's outputs without verification.

  • Conduct their own evaluation of Inkling-Small's performance, safety, and fairness for their specific use case, language, and population prior to deployment, particularly for applications involving vulnerable groups.
  • Implement additional safeguards – such as content filtering, rate limiting, and monitoring – at the application layer, especially for open deployment contexts where Inkling-Small's built-in mitigations may not be sufficient on their own.
  • Avoid deploying Inkling-Small in domains such as medical, legal, or safety-critical decision-making without additional fine-tuning, domain-specific validation, and human oversight

8. Legal

Training Data Documentation

Configuration

Architecture
InklingForConditionalGeneration
Layers
42
Hidden size
4,096
Feed-forward size
2,048
Attention heads
32
Key/value heads
8
Head dimension
128
Vocabulary size
201,024
Routed experts
256
Experts active per token
6
Stored precision
bfloat16
Model type
inkling_mm_model

Identity and Version

Repository
thinkingmachines/Inkling-Small
Publisher
Thinking Machines Lab
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
266B parameters
Languages
moe
Revision
8cc5877b44d343f88b92086aa1fb72897950f06a
First published
2026-07-27
Last updated
2026-07-31

Files and Weights

50 files, 531.9 GB in total. The weights are 33 files totalling 531.9 GB in safetensors.

Weights33 files · 531.9 GB
Configuration11 files · 91.6 KB
Tokenizer3 files · 31.5 MB
Documentation1 file · 43.9 KB
Other1 file · 6.3 KB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00032.safetensorsWeights17.3 GB 2c5760219bfa
model-00002-of-00032.safetensorsWeights13.0 GB 014c270641a0
model-00003-of-00032.safetensorsWeights17.3 GB 1f054436b87f
model-00004-of-00032.safetensorsWeights17.2 GB af080715e621
model-00005-of-00032.safetensorsWeights12.9 GB 0db9928ec7ca
model-00006-of-00032.safetensorsWeights13.4 GB ec21b6981f0b
model-00007-of-00032.safetensorsWeights17.6 GB 215104d66deb
model-00008-of-00032.safetensorsWeights13.1 GB bcaa55a91742
model-00009-of-00032.safetensorsWeights17.8 GB a2787970b24c
model-00010-of-00032.safetensorsWeights13.1 GB 5fe304f2795d
model-00011-of-00032.safetensorsWeights17.6 GB f0d6f8172c58
model-00012-of-00032.safetensorsWeights17.7 GB 676548e503fc
model-00013-of-00032.safetensorsWeights17.6 GB 26a849e4d6d7
model-00014-of-00032.safetensorsWeights17.5 GB d3e59b8cdd4c
model-00015-of-00032.safetensorsWeights13.1 GB b42516a6c2e9
model-00016-of-00032.safetensorsWeights17.2 GB c231d7aad10a
model-00017-of-00032.safetensorsWeights17.5 GB 336920d3f165
model-00018-of-00032.safetensorsWeights13.3 GB ad2d3be6ec35
model-00019-of-00032.safetensorsWeights14.6 GB bc16198204e3
model-00020-of-00032.safetensorsWeights17.3 GB 92f3a7bc1d96
model-00021-of-00032.safetensorsWeights17.6 GB 88226d764156
model-00022-of-00032.safetensorsWeights17.9 GB f537311d87b7
model-00023-of-00032.safetensorsWeights17.5 GB 8baab9f74750
model-00024-of-00032.safetensorsWeights17.3 GB 8cac09baa9e0
model-00025-of-00032.safetensorsWeights17.5 GB f15df1396235
model-00026-of-00032.safetensorsWeights17.6 GB a572416ba29b
model-00027-of-00032.safetensorsWeights17.3 GB 1a85d05def90
model-00028-of-00032.safetensorsWeights17.4 GB 722ef9ca3c9c
model-00029-of-00032.safetensorsWeights17.5 GB 41a072309c03
model-00030-of-00032.safetensorsWeights18.9 GB 42d167ed4123
model-00031-of-00032.safetensorsWeights17.2 GB b3a6ce459934
model-00032-of-00032.safetensorsWeights17.4 GB 7b5ec62865af
mtp.safetensorsWeights4.5 GB d286dd21cb98
.eval_results/aime_2026.yamlConfiguration180 B —
.eval_results/gpqa.yamlConfiguration164 B —
.eval_results/hle.yamlConfiguration172 B —
.eval_results/hmmt_feb_2026.yamlConfiguration188 B —
.eval_results/mmmu_pro.yamlConfiguration181 B —
.eval_results/swe-bench_pro.yamlConfiguration176 B —
.eval_results/swe-bench_verified.yamlConfiguration190 B —
config.jsonConfiguration2.2 KB —
model.safetensors.index.jsonConfiguration86.5 KB —
processor_config.jsonConfiguration1.1 KB —
special_tokens_map.jsonConfiguration517 B —
README.mdDocumentation43.9 KB —
chat_template.jinjaOther6.3 KB —
.gitattributesRepository1.6 KB —
tiktoken/tokenizer.modelTokenizer3.6 MB bc253fd2b702
tokenizer.jsonTokenizer27.9 MB 9fb6333a7db8
tokenizer_config.jsonTokenizer12.1 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
531.9 GB
Download from Thinking Machines Lab

Released by Thinking Machines Lab through its official repository on Hugging Face. Read the license.

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
Idavidrein/gpqa Task diamondMetric diamondComparison conditions not established 89.5 Model Card
Reported by a third party
Evaluated revision not stated 2026-07-31
MMMU/MMMU_Pro Task mmmu_pro_standard_10_optionsMetric mmmu_pro_standard_10_optionsComparison conditions not established 74 Model Card
Reported by a third party
Evaluated revision not stated 2026-07-31
MathArena/aime_2026 Task MathArena/aime_2026Metric MathArena/aime_2026Comparison conditions not established 95.5 Model Card
Reported by a third party
Evaluated revision not stated 2026-07-31
MathArena/hmmt_feb_2026 Task MathArena/hmmt_feb_2026Metric MathArena/hmmt_feb_2026Comparison conditions not established 90.2 Model Card
Reported by a third party
Evaluated revision not stated 2026-07-31
SWE-bench/SWE-bench_Verified Task swe_bench_%_resolvedMetric swe_bench_%_resolvedComparison conditions not established 80.2 Model Card
Reported by a third party
Evaluated revision not stated 2026-07-31
ScaleAI/SWE-bench_Pro Task SWE_Bench_ProMetric SWE_Bench_ProComparison conditions not established 55.9 Model Card
Reported by a third party
Evaluated revision not stated 2026-07-31
cais/hle Task hleMetric hleSetup text onlyComparison conditions not established 31.6 Model Card
Reported by a third party
Evaluated revision not stated 2026-07-31

Memory Requirements

PrecisionWeights in memory
As published531.9 GB
16-bit531.9 GB
8-bit266.0 GB
4-bit133.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Hosted Prices

HostInput / outputUnitObserved
DeepInfra$0.45 / $1.20input / output, per million tokensOct 27, 2026

From the SAVRN Index.

Built on This Model

Questions About Inkling-Small

How much GPU memory does Inkling-Small need?

About 638.3 GB at 16-bit and 159.6 GB at 4-bit: the weights (266B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Inkling-Small on?

At 16-bit, 3x MI325X from $6.00 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use Inkling-Small commercially?

Yes. Inkling-Small is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Image and text to text

Inkling-Small-MXFP4-AutoRound

Intel AI

This model is an MXFP4 (W4A16, groupsize 32) model of thinkingmachines/Inkling-Small generated by intel/auto-round using RTN. Please follow the license of the original model. Note: Baseline corresponds to NVFP4 reference evaluated under identical settings. The model can produce factually incorrect output, and should not be relied on to produce factually accurate information. Because of the limitations of the pretrained model and the finetuning datasets, it is possible that this model could generate lewd, biased or otherwise offensive outputs. Therefore, before deploying any applications of the model, developers should perform safety testing. Users (both direct and downstream) should be made…

Open weights apache-2.0 266B parameters transformers

Model · Image and text to text

MiniMax-M3.1-Flash

MiniMax

MiniMax-M3.1-Flash is a native multimodal mixture-of-experts model for coding, agentic workflows, computer use, and cybersecurity. It supports text, image, and video inputs with a context window of up to 1M tokens. Building on MiniMax-M3, M3.1-Flash improves task performance and inference efficiency with sparse attention throughout the model, quantization-aware training, and DSpark speculative decoding. - Agents’ Last Exam: Official Overall setting; full-set results from the official ALE leaderboard only. Blank = no official result (CLI-only excluded), not zero. Results are for the official weights; third-party quantizations may differ. M3.1-Flash retains M3’s core mixture-of-experts…

Open weights other 220.5B parameters 1,048,576 tokens transformers

Model · Image and text to text

GLM-5.3-Flash

Z.ai

Join our WeChat or Discord community. Check out the GLM-5.3-Flash blog and GLM-5 Technical report. Use GLM-5.3-Flash API services on Z.ai API Platform. We introduce GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. With 320B total parameters and just 18B active parameters, it outperforms GLM-5.2 across benchmarks and real-world workloads at one-tenth the price, while approaching Claude Opus 4.8 on coding and agentic benchmarks. GLM-5.3-Flash starts from a newly trained base model, with its architecture and training recipe redesigned around capability and efficiency. For the first time in the GLM series, we introduce a hybrid architecture combining sparse and linear…

Open weights mit 321.3B parameters 1,048,576 tokens transformers

Model · Image and text to text

not-a-GLM-5.3-Flash-backup

Michael Fielding

Join our WeChat or Discord community. Check out the GLM-5.3-Flash blog and GLM-5 Technical report. Use GLM-5.3-Flash API services on Z.ai API Platform. We introduce GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. With 320B total parameters and just 18B active parameters, it outperforms GLM-5.2 across benchmarks and real-world workloads at one-tenth the price, while approaching Claude Opus 4.8 on coding and agentic benchmarks. GLM-5.3-Flash starts from a newly trained base model, with its architecture and training recipe redesigned around capability and efficiency. For the first time in the GLM series, we introduce a hybrid architecture combining sparse and linear…

Open weights mit 321.3B parameters 1,048,576 tokens transformers

Model · Image and text to text

Step-5-Preview-NVFP4-Local

Brandon Music

A lossless repack of stepfun-ai/Step-5-Preview-NVFP4 (revision bc246cc2848e17b37f377eda8fd825c5b3018d1f), 17.1 GB smaller. The NVFP4 block scales of the routed experts are stored in b12x's compressed scale format (CSF), the lossless format introduced with nvidia/Qwen3.8-Flash-Next-FP4-Local. Every FP4 weight byte and every other tensor is identical to StepFun's checkpoint, and every scale decodes to StepFun's exact bytes, so this checkpoint computes exactly what Step-5-Preview-NVFP4 computes. Step 5 Preview is StepFun AI's model: a sparse mixture of experts with 600B total and 27B active parameters, text and image input, up to 1M tokens of context. Model card: stepfun-ai/Step-5-Preview.…

Open weights other 338.5B parameters 1,048,576 tokens