SAVRN
Search Contact SAVRN

Open-weight model · Text generation

moondream3.1-9B-A2B-GGUF

by Amaimediacom AMAImedia/moondream3.1-9B-A2B-GGUF

moondream3.1-9B-A2B-GGUF is an open-weight model for text generation from Amaimediacom, released under other. Its published files total 42.9 GB.

Local hardware: Mechrevo Kuangshi GM7AG0M — RTX 3060 Laptop 6GB GDDR6, 64GB DDR5, i7-12700H (14C/20T, 4.7GHz), Windows 11, Samsung 990 Pro. Good for imatrix and 0.6–35B-class work in RAM. 9B+ and searches need rented H200/Blackwell, typically $100 per quant.

Parameters—
Context—
Weights42.9 GB
Licenseother
AccessOpen weights
Monthly Downloads—

Model Card

Local hardware: Mechrevo Kuangshi GM7AG0M — RTX 3060 Laptop 6GB GDDR6, 64GB DDR5, i7-12700H (14C/20T, 4.7GHz), Windows 11, Samsung 990 Pro. Good for imatrix and 0.6–35B-class work in RAM. 9B+ and searches need rented H200/Blackwell, typically $100 per quant. Released as part of the NOESIS Professional Multilingual Dubbing Automation Platform (framework: Deterministic Hybrid Control Framework for Frozen Neural Operators — DHCF-FNO). GGUF-конвертация и кванты текстового бэкбона Moondream 3.1 — vision-language модели с MoE-архитектурой (9B всего / 2B активных параметров). Конвертация и квантование выполнены AMAImedia; vision-часть (mmproj) в репозиторий не входит. Все файлы…

Excerpt from the card by Amaimediacom, licensed other.

Identity and Version

Repository
AMAImedia/moondream3.1-9B-A2B-GGUF
Publisher
Amaimediacom
Task
Text generation
Modality
Text
Library
llama.cpp
Parameters
Not stated by the source
Languages
en
Revision
4a3cc770fd119fa6fd630bc245c7f2f379cbf096
First published
2026-09-24
Last updated
2026-09-24

Files and Weights

19 files, 42.9 GB in total. The weights are 5 files totalling 42.9 GB in gguf.

Weights5 files · 42.9 GB
Configuration2 files · 16.8 KB
Documentation5 files · 39.6 KB
Other6 files · 136.1 KB
Repository1 file · 1.8 KB
Every file
FileTypeSizeSHA-256
moondream3.1-9B-A2B-Q2_K.ggufWeights3.3 GB 8af8a7165e0c
moondream3.1-9B-A2B-Q4_K_M.ggufWeights5.4 GB 4d41cb429c95
moondream3.1-9B-A2B-Q6_K.ggufWeights7.2 GB 9f3d61e185c7
moondream3.1-9B-A2B-Q8_0.ggufWeights9.4 GB 81c318d11a80
moondream3.1-text-F16.ggufWeights17.6 GB 1209e687ea9d
code/config.jsonConfiguration1.2 KB —
code/convert_moondream3.pyConfiguration15.6 KB —
LICENSE.mdDocumentation20.9 KB —
README.mdDocumentation8.4 KB —
README_en.mdDocumentation6.6 KB —
code/README.mdDocumentation1.6 KB —
code/UPDATE-2026-09-24.mdDocumentation2.1 KB —
code/NOTES.txtOther20.1 KB —
code/convert_run_v2.logOther1.2 KB —
code/llama3mod-moondream3.patchOther22.8 KB —
code/mapping_dry.logOther36.1 KB —
code/quantize_all.shOther448 B —
code/tensors.txtOther55.5 KB —
.gitattributesRepository1.8 KB —

License and Download

License
other
Access
Open weights, no gate
Download size
42.9 GB
Download from Amaimediacom

Released by Amaimediacom through its official repository on Hugging Face.

Built From

Memory Requirements

PrecisionWeights in memory
As published42.9 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About moondream3.1-9B-A2B-GGUF

What license is moondream3.1-9B-A2B-GGUF released under?

other, as its publisher declares it. Read the license text before commercial use.

Similar Models

Fine-tune Qwen3 (14B) for free using our Google Colab notebook! - Read our Blog about Qwen3 support: unsloth.ai/blog/qwen3 - View the rest of our notebooks in our docs here. Qwen3-Coder is available in multiple sizes. Today, we're excited to introduce Qwen3-Coder-30B-A3B-Instruct. This streamlined model maintains impressive performance and efficiency, featuring the following key enhancements: - Significant Performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks. - Long-context Capabilities with native support for 256K tokens, extendable up to 1M tokens using Yarn, optimized for repository-scale understanding. - Agentic Coding supporting for…

Open weights apache-2.0 transformers

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers