Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

Llama-3.2-1B-Instruct-ExecuTorch

by Experimental Machines experimentalmachines/Llama-3.2-1B-Instruct-ExecuTorch

Llama-3.2-1B-Instruct-ExecuTorch is an open-weight model for text generation from Experimental Machines, released under llama3.2. Its published files total 21.6 GB. It draws 264 downloads a month.

Built with Llama ExecuTorch exports of meta-llama/Llama-3.2-1B-Instruct (revision 9213176726f5) for on-device inference with the openweights Android app or any ExecuTorch 1.4.0 runtime.

Parameters—
Context—
Weights1.1 GB
Licensellama3.2
AccessOpen weights
Monthly Downloads264

Model Card

Built with Llama ExecuTorch exports of meta-llama/Llama-3.2-1B-Instruct (revision 9213176726f5) for on-device inference with the openweights Android app or any ExecuTorch 1.4.0 runtime. Windows in this repo: XNNPACK (CPU) at 2k to 32k; Vulkan (GPU) at 2k to 32k; Qualcomm QNN (HTP) SM8750 (Snapdragon 8 Elite) at 2k to 8k; MediaTek NeuroPilot MT6991 (Dimensity 9400) at 2k to 16k. The window is fixed inside the file: the runtime allocates the whole KV cache at load, so pick the largest window the device can hold (fitsphonebudget in each folder's config.json is the estimate against a 5 GB budget). MediaTek folders also hold the token embedding table the NeuroPilot runner reads from disk, shared…

Excerpt from the card by Experimental Machines, licensed llama3.2.

Identity and Version

Repository
experimentalmachines/Llama-3.2-1B-Instruct-ExecuTorch
Publisher
Experimental Machines
Task
Text generation
Modality
Text
Library
executorch
Parameters
Not stated by the source
Languages
mtk, on-device, qnn
Revision
a77a569972cbbab9fd83df0f6e240dadf7730556
First published
2026-09-13
Last updated
2026-10-08

Files and Weights

57 files, 21.6 GB in total. The weights are 1 file totalling 1.1 GB in bin.

Weights1 file · 1.1 GB
Configuration21 files · 142.0 KB
Tokenizer1 file · 9.1 MB
Documentation4 files · 28.5 KB
Other29 files · 20.5 GB
Repository1 file · 4.7 KB
Every file
FileTypeSizeSHA-256
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-embedding-fp32.binWeights1.1 GB d1602ecf8f4e
mtk/mt6991/config.jsonConfiguration10.1 KB —
mtk/mt6991/export-report-16k.jsonConfiguration5.5 KB —
mtk/mt6991/export-report-2k.jsonConfiguration5.5 KB —
mtk/mt6991/export-report-4k.jsonConfiguration5.5 KB —
mtk/mt6991/export-report-8k.jsonConfiguration5.5 KB —
qnn/sm8750/config.jsonConfiguration2.0 KB —
qnn/sm8750/export-report-2k.jsonConfiguration10.4 KB —
qnn/sm8750/export-report-4k.jsonConfiguration10.4 KB —
qnn/sm8750/export-report-8k.jsonConfiguration10.3 KB —
vulkan/config.jsonConfiguration4.2 KB —
vulkan/export-report-16k.jsonConfiguration5.7 KB —
vulkan/export-report-2k.jsonConfiguration5.7 KB —
vulkan/export-report-32k.jsonConfiguration5.7 KB —
vulkan/export-report-4k.jsonConfiguration5.7 KB —
vulkan/export-report-8k.jsonConfiguration5.7 KB —
xnnpack/config.jsonConfiguration4.2 KB —
xnnpack/export-report-16k.jsonConfiguration8.0 KB —
xnnpack/export-report-2k.jsonConfiguration8.0 KB —
xnnpack/export-report-32k.jsonConfiguration8.1 KB —
xnnpack/export-report-4k.jsonConfiguration8.0 KB —
xnnpack/export-report-8k.jsonConfiguration8.0 KB —
LICENSE.txtDocumentation7.7 KB —
NOTICEDocumentation116 B —
README.mdDocumentation14.7 KB —
USE_POLICY.mdDocumentation6.0 KB —
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-16k-chunk1of4.pteOther279.9 MB 0e3586e955c8
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-16k-chunk2of4.pteOther279.9 MB d1a6e789e972
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-16k-chunk3of4.pteOther279.9 MB 7c13476107e0
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-16k-chunk4of4.pteOther543.3 MB 475266c6ce4b
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-2k-chunk1of4.pteOther277.8 MB a2afe0c37d35
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-2k-chunk2of4.pteOther277.8 MB 4e6b61c2504c
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-2k-chunk3of4.pteOther277.8 MB e4eeddd7742a
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-2k-chunk4of4.pteOther541.2 MB e2f6694f0b07
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-4k-chunk1of4.pteOther277.8 MB 904ebe435c11
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-4k-chunk2of4.pteOther277.8 MB 6e159b3b6f57
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-4k-chunk3of4.pteOther277.8 MB b22a7594a6dc
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-4k-chunk4of4.pteOther541.2 MB cfe809850c2e
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-8k-chunk1of4.pteOther279.0 MB d9b33327ea15
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-8k-chunk2of4.pteOther279.0 MB e257bdef8860
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-8k-chunk3of4.pteOther279.0 MB a0cc98c68637
mtk/mt6991/Llama-3.2-1B-Instruct-neuropilot-a16w8-8k-chunk4of4.pteOther542.4 MB a7c11b92af75
qnn/sm8750/Llama-3.2-1B-Instruct-qnn-hybrid-2k.pteOther1.4 GB 3a2d1d2ce356
qnn/sm8750/Llama-3.2-1B-Instruct-qnn-hybrid-4k.pteOther1.4 GB c36a379d57b7
qnn/sm8750/Llama-3.2-1B-Instruct-qnn-hybrid-8k.pteOther1.4 GB bfdba8a1549d
vulkan/Llama-3.2-1B-Instruct-vulkan-8da4w-16k.pteOther1.2 GB 5863a3430ae0
vulkan/Llama-3.2-1B-Instruct-vulkan-8da4w-2k.pteOther1.2 GB ee1253bb66f1
vulkan/Llama-3.2-1B-Instruct-vulkan-8da4w-32k.pteOther1.3 GB 68286859fb63
vulkan/Llama-3.2-1B-Instruct-vulkan-8da4w-4k.pteOther1.2 GB 092d3a121de9
vulkan/Llama-3.2-1B-Instruct-vulkan-8da4w-8k.pteOther1.2 GB 875dad165004
xnnpack/Llama-3.2-1B-Instruct-8da4w-gptq-16k.pteOther967.3 MB 7f551f1f00d7
xnnpack/Llama-3.2-1B-Instruct-8da4w-gptq-2k.pteOther960.0 MB f82c34bc8698
xnnpack/Llama-3.2-1B-Instruct-8da4w-gptq-32k.pteOther975.7 MB 59f96d5d30fb
xnnpack/Llama-3.2-1B-Instruct-8da4w-gptq-4k.pteOther961.0 MB 9e3d3ba799dd
xnnpack/Llama-3.2-1B-Instruct-8da4w-gptq-8k.pteOther963.1 MB 5171821afd91
.gitattributesRepository4.7 KB —
tokenizer.jsonTokenizer9.1 MB —

License and Download

License
llama3.2
Access
Open weights, no gate
Download size
1.1 GB
Download from Experimental Machines

Released by Experimental Machines through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published1.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Llama-3.2-1B-Instruct-ExecuTorch

What license is Llama-3.2-1B-Instruct-ExecuTorch released under?

llama3.2, as its publisher declares it. Read the license text before commercial use.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp