SAVRN
Search Contact SAVRN

Open-weight model · Text generation

idefics-9b

by HuggingFaceM4 HuggingFaceM4/idefics-9b

How do I pronounce the model's name? Watch a Youtube tutorial IDEFICS (Image-aware Decoder Enhanced à la Flamingo with Interleaved Cross-attentionS) is an open-access reproduction of Flamingo, a closed-source visual language model developed by Deepmind.

Parameters8.9B
Context2,048
Weights71.4 GB
Licenseother
AccessOpen weights
Monthly Downloads19.8k

Runs On

What it takes to serve idefics-9b (8.9B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 17.9 GB 21.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 8.9 GB 10.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.5 GB 5.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

How do I pronounce the model's name? Watch a Youtube tutorial IDEFICS (Image-aware Decoder Enhanced à la Flamingo with Interleaved Cross-attentionS) is an open-access reproduction of Flamingo, a closed-source visual language model developed by Deepmind. Like GPT-4, the multimodal model accepts arbitrary sequences of image and text inputs and produces text outputs. IDEFICS is built solely on publicly available data and models. The model can answer questions about images, describe visual contents, create stories grounded on multiple images, or simply behave as a pure language model without visual inputs. IDEFICS is on par with the original closed-source model on various image-text benchmarks…

Excerpt from the card by HuggingFaceM4, licensed other.

Configuration

Architecture
IdeficsForVisionText2Text
Context length (tokens)
2,048
Layers
32
Hidden size
4,096
Feed-forward size
11,008
Attention heads
32
Vocabulary size
32,000
Stored precision
bfloat16
Model type
idefics

Identity and Version

Repository
HuggingFaceM4/idefics-9b
Publisher
HuggingFaceM4
Task
Text generation
Modality
Text
Library
transformers
Parameters
8.9B parameters
Languages
en
Revision
4986969d084dd36ed0acf20990c64faa7e817df1
First published
2023-07-11
Last updated
2023-10-12

Files and Weights

54 files, 71.4 GB in total. The weights are 38 files totalling 71.4 GB in bin, safetensors.

Weights38 files · 71.4 GB
Configuration7 files · 200.4 KB
Tokenizer3 files · 2.3 MB
Documentation1 file · 43.2 KB
Other4 files · 4.1 MB
Repository1 file · 1.6 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00019.safetensorsWeights2.0 GB ecd17b50b8b9
model-00002-of-00019.safetensorsWeights1.8 GB 11c73e9247c8
model-00003-of-00019.safetensorsWeights2.0 GB 109eb6a68b00
model-00004-of-00019.safetensorsWeights1.9 GB 2cf6542348cd
model-00005-of-00019.safetensorsWeights1.9 GB 5af265a83102
model-00006-of-00019.safetensorsWeights2.0 GB ed08f44bc877
model-00007-of-00019.safetensorsWeights1.9 GB 5054c16adef2
model-00008-of-00019.safetensorsWeights2.0 GB 18291f1ed538
model-00009-of-00019.safetensorsWeights1.9 GB 52acf17b847e
model-00010-of-00019.safetensorsWeights1.9 GB 462c8a90066b
model-00011-of-00019.safetensorsWeights2.0 GB 1737bedead11
model-00012-of-00019.safetensorsWeights1.9 GB b7fd23d6383e
model-00013-of-00019.safetensorsWeights2.0 GB 7e73f319498b
model-00014-of-00019.safetensorsWeights1.9 GB 23440d85fc6e
model-00015-of-00019.safetensorsWeights1.9 GB 68cc998a89cd
model-00016-of-00019.safetensorsWeights2.0 GB c1acf64f64b8
model-00017-of-00019.safetensorsWeights2.0 GB 6958fb490152
model-00018-of-00019.safetensorsWeights2.0 GB ccd1cb35844c
model-00019-of-00019.safetensorsWeights704.7 MB a0e1083c5110
pytorch_model-00001-of-00019.binWeights2.0 GB 990ffc571b5c
pytorch_model-00002-of-00019.binWeights1.8 GB b8e081395dba
pytorch_model-00003-of-00019.binWeights2.0 GB 4f6b46a9f64c
pytorch_model-00004-of-00019.binWeights1.9 GB d525b3ad30b9
pytorch_model-00005-of-00019.binWeights1.9 GB 5a71594bd721
pytorch_model-00006-of-00019.binWeights2.0 GB f3d5a20c4c04
pytorch_model-00007-of-00019.binWeights1.9 GB 9ea98e1b751f
pytorch_model-00008-of-00019.binWeights2.0 GB 05608b713472
pytorch_model-00009-of-00019.binWeights1.9 GB 8d49b3957db8
pytorch_model-00010-of-00019.binWeights1.9 GB 039d41e5bd9b
pytorch_model-00011-of-00019.binWeights2.0 GB 10c55837eca0
pytorch_model-00012-of-00019.binWeights1.9 GB 8ba54ec2ebb0
pytorch_model-00013-of-00019.binWeights2.0 GB 2b2538788612
pytorch_model-00014-of-00019.binWeights1.9 GB f54277215742
pytorch_model-00015-of-00019.binWeights1.9 GB f3c2037e5e41
pytorch_model-00016-of-00019.binWeights2.0 GB cdd0da29f21b
pytorch_model-00017-of-00019.binWeights2.0 GB d8486fbd00b2
pytorch_model-00018-of-00019.binWeights2.0 GB 4e51d6c05db1
pytorch_model-00019-of-00019.binWeights704.7 MB 9670df10ee76
added_tokens.jsonConfiguration61 B
config.jsonConfiguration1.4 KB
generation_config.jsonConfiguration137 B
model.safetensors.index.jsonConfiguration99.2 KB
preprocessor_config.jsonConfiguration281 B
pytorch_model.bin.index.jsonConfiguration99.2 KB
special_tokens_map.jsonConfiguration181 B
README.mdDocumentation43.2 KB
assets/Figure_Evals_IDEFICS.pngOther2.0 MB 5adef77aef16
assets/IDEFICS.pngOther208.9 KB f19cb8403640
assets/Idefics_colab.pngOther1.4 MB 0c8edfcda54a
assets/guarding_baguettes.pngOther455.1 KB d88ae51fd8ca
.gitattributesRepository1.6 KB
tokenizer.jsonTokenizer1.8 MB
tokenizer.modelTokenizer499.7 KB 9e556afd4421
tokenizer_config.jsonTokenizer1.4 KB

License and Download

License
other
Access
Open weights, no gate
Download size
71.4 GB
Download from HuggingFaceM4

Released by HuggingFaceM4 through its official repository on Hugging Face.

Built From

  • Described by arXiv:1808.10584
  • Described by arXiv:1910.07467
  • Described by arXiv:2109.05014
  • Described by arXiv:2204.02311
  • Described by arXiv:2204.14198
  • Described by arXiv:2302.05442
  • Described by arXiv:2303.12733
  • Described by arXiv:2306.05425
  • Described by arXiv:2306.16527
  • Described by arXiv:2307.06281
  • Trained on (disclosed) HuggingFaceM4/OBELICS
  • Trained on (disclosed) facebook/pmd
  • Trained on (disclosed) laion/laion2B-en
  • Trained on (disclosed) wikipedia

Memory Requirements

PrecisionWeights in memory
As published71.4 GB
16-bit17.9 GB
8-bit8.9 GB
4-bit4.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About idefics-9b

How much GPU memory does idefics-9b need?

About 21.4 GB at 16-bit and 5.4 GB at 4-bit: the weights (8.9B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run idefics-9b on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is idefics-9b released under?

other, as its publisher declares it. Read the license text before commercial use.

What is idefics-9b's context length?

2,048 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

dQwen3.5-9B-Base

IFML

A masked diffusion language model adapted from Qwen3.5-9B. The backbone is hybrid: only its attention layers are made bidirectional, and the Gated DeltaNet layers stay causal. This is a base model, with no instruction tuning. Paper: dQwen3.5: Hybrid-Attention Diffusion Language Models. Code: https://github.com/AntonXue/dQwen Needs a CUDA GPU and transformers>=5.13 (tested with torch 2.7.1+cu128, flash-linear-attention 0.5.1). generate decodes the whole canvas at once, committing positions above a confidence threshold (tau=0.9); pass blocklength=32 for left-to-right block decoding, or tau=None, stepsperblock=k for a fixed budget. The 50B-token checkpoint from the paper is…

Open weights apache-2.0 9B parameters 262,144 tokens transformers

Model · Text generation

gemma-2-9b-it

Google

[Responsible Generative AI Toolkit][rai-toolkit] [Gemma on Kaggle][kaggle-gemma] [Gemma on Vertex Model Garden][vertex-mg-gemma] Summary description and brief definition of inputs and outputs. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. They are text-to-text, decoder-only large language models, available in English, with open weights for both pre-trained variants and instruction-tuned variants. Gemma models are well-suited for a variety of text generation tasks, including question answering, summarization, and reasoning. Their relatively small size makes it possible to deploy them…

Access requested at publisher gemma 9.2B parameters transformers

This model is a fine-tuned version of LiquidAI/LFM2.5-8B-A1B, adapted on the angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k dataset for English text-generation and reasoning-style responses. The fine-tuning run used a custom Convergent Intelligence optimizer stack, CIxOpt, designed for heterogeneous routing across parameter types. The goal of this checkpoint is to test whether a Liquid Foundation Model backbone can be adapted efficiently through targeted sparse participation rather than broad full-model modification. This is an experimental research checkpoint intended for continued evaluation, domain adaptation, and architecture/optimizer testing.…

Open weights apache-2.0 8.5B parameters 128,000 tokens transformers

DuoNeural/LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated-v2 is an apex-tier, uncensored autonomous agentic coding model trained by DuoNeural (Aura, Archon, and Jesse). Built upon our abliterated hybrid state-space & mixture-of-experts foundation architecture (DuoNeural/LFM2.5-8B-A1B-Abliterated), this model activates only 1.5 billion parameters per token out of its 8.3 billion total parameters, delivering blistering inference speeds (~360 tokens/sec on RTX 4080 Super / 3090, and ~80–90 tokens/sec on legacy mobile GPUs like the GTX 1070) while running in under 6 GB VRAM with Q4KM quantization. In our preliminary v1 release, an assistant role delimiter mismatch during training collation…

Open weights other 8.5B parameters 128,000 tokens hermes

DuoNeural/LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated is an apex-tier, uncensored autonomous agentic coding model trained by DuoNeural (Aura, Archon, and Jesse). Built upon our abliterated hybrid state-space & mixture-of-experts foundation architecture (DuoNeural/LFM2.5-8B-A1B-Abliterated), this model activates only 1.5 billion parameters per token out of its 8.3 billion total parameters, delivering blistering inference speeds (~380–400 tokens/sec on consumer GPUs like RTX 3090, and ~90 tokens/sec on legacy GTX 1070 laptops) while fitting in under 6 GB VRAM with Q4KM quantization. 1. Native Hermes Agentic Loop: - Explicit... deliberation before every action. - Structured... containers…

Open weights other 8.5B parameters 128,000 tokens hermes

Model · Text generation

Qwen3-8B-FP8

Qwen

Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features: - Uniquely support of seamless switching between thinking mode (for complex logical reasoning, math, and coding) and non-thinking mode (for efficient, general-purpose dialogue) within single model, ensuring optimal performance across various scenarios. - Significantly enhancement in its reasoning capabilities, surpassing previous QwQ (in thinking mode) and…

Open weights apache-2.0 8.2B parameters 40,960 tokens transformers