SAVRN
Search Contact SAVRN

Open-weight model · Image and text to text

llava-1.5-7b-hf

by Llava Hugging Face llava-hf/llava-1.5-7b-hf

Below is the model card of Llava model 7b, which is copied from the original Llava model card that you can find here. Check out also the Google Colab demo to run Llava on a free-tier Google Colab instance: Or check out our Spaces demo!

Parameters7.1B
Context4,096
Weights14.1 GB
Licensellama2
AccessOpen weights
Monthly Downloads1.8M

Runs On

What it takes to serve llava-1.5-7b-hf (7.1B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 14.1 GB 17.0 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 7.1 GB 8.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 3.5 GB 4.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on llava-1.5-7b-hf

Put a picture in front of this model and ask about it in words; that is what LLaVA 1.5 7B does, with 7.1 billion parameters. The float16 weights as shipped take 14.1 GB on disk and 17.0 GB of accelerator memory. The cheapest setup we track is one MI300X with 192 GB at $1.85 per hour on demand, and 17 GB on a 192 GB card leaves room to run several copies or other jobs beside it. At 8-bit the need drops to 8.5 GB and at 4-bit to 4.2 GB.

The license field reads llama2, with no summary of its terms in our records, so read it yourself before a commercial deployment. Context is 4,096 tokens, short for long documents beside an image. It was trained on LLaVA-Instruct-150K, and the Index lists no per-token host price for it, so budget by the hour.

Model Card

Below is the model card of Llava model 7b, which is copied from the original Llava model card that you can find here. Check out also the Google Colab demo to run Llava on a free-tier Google Colab instance: Or check out our Spaces demo! LLaVA is an open-source chatbot trained by fine-tuning LLaMA/Vicuna on GPT-generated multimodal instruction-following data. It is an auto-regressive language model, based on the transformer architecture. LLaVA-v1.5-7B was trained in September 2023. Paper or resources for more information: https://llava-vl.github.io/ First, make sure to have transformers >= 4.35.3. The model supports multi-image and multi-prompt generation. Meaning that you can pass multiple…

Excerpt from the card by Llava Hugging Face, licensed llama2.

Configuration

Architecture
LlavaForConditionalGeneration
Context length (tokens)
4,096
Vocabulary size
32,064
Stored precision
float16
Model type
llava

Identity and Version

Repository
llava-hf/llava-1.5-7b-hf
Publisher
Llava Hugging Face
Task
Image and text to text
Modality
Image and text
Library
transformers
Parameters
7.1B parameters
Languages
en
Revision
b234b804b114d9e37bb655e11cbbb5f5e971b7a9
First published
2023-12-05
Last updated
2025-06-06

Files and Weights

17 files, 14.1 GB in total. The weights are 3 files totalling 14.1 GB in safetensors.

Weights3 files · 14.1 GB
Configuration8 files · 73.2 KB
Tokenizer3 files · 4.1 MB
Documentation1 file · 5.6 KB
Other1 file · 674 B
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00003.safetensorsWeights5.0 GB c11dbf016ee7
model-00002-of-00003.safetensorsWeights5.0 GB 46df6c6e5fad
model-00003-of-00003.safetensorsWeights4.2 GB 4f06177c37ca
added_tokens.jsonConfiguration41 B
chat_template.jsonConfiguration701 B
config.jsonConfiguration950 B
generation_config.jsonConfiguration141 B
model.safetensors.index.jsonConfiguration70.1 KB
preprocessor_config.jsonConfiguration505 B
processor_config.jsonConfiguration173 B
special_tokens_map.jsonConfiguration552 B
README.mdDocumentation5.6 KB
chat_template.jinjaOther674 B
.gitattributesRepository1.5 KB
tokenizer.jsonTokenizer3.6 MB
tokenizer.modelTokenizer499.7 KB 9e556afd4421
tokenizer_config.jsonTokenizer1.5 KB

License and Download

License
llama2
Access
Open weights, no gate
Download size
14.1 GB
Download from Llava Hugging Face

Released by Llava Hugging Face through its official repository on Hugging Face.

Built From

  • Trained on (disclosed) liuhaotian/LLaVA-Instruct-150K

Memory Requirements

PrecisionWeights in memory
As published14.1 GB
16-bit14.1 GB
8-bit7.1 GB
4-bit3.5 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About llava-1.5-7b-hf

How much GPU memory does llava-1.5-7b-hf need?

About 17 GB at 16-bit and 4.2 GB at 4-bit: the weights (7.1B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run llava-1.5-7b-hf on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is llava-1.5-7b-hf released under?

llama2, as its publisher declares it. Read the license text before commercial use.

What is llava-1.5-7b-hf's context length?

4,096 tokens, from the maximum position embeddings in its published configuration.

Similar Models

This model was produced by fine-tuning the OpenVLA 7B model via LoRA (r=32) on the LIBERO-Spatial dataset from the LIBERO simulation benchmark. We made a few modifications to the training dataset to improve final performance (see the OpenVLA paper for details). Below are the hyperparameters we used for all LIBERO experiments: - No gradient accumulation (i.e. gradaccumulationsteps == 1) - shufflebuffersize == 100000 See the OpenVLA GitHub README for instructions on how to run and evaluate this model in the LIBERO simulator.

Open weights mit 7.5B parameters transformers

This model was produced by fine-tuning the OpenVLA 7B model via LoRA (r=32) on the LIBERO-Object dataset from the LIBERO simulation benchmark. We made a few modifications to the training dataset to improve final performance (see the OpenVLA paper for details). Below are the hyperparameters we used for all LIBERO experiments: - No gradient accumulation (i.e. gradaccumulationsteps == 1) - shufflebuffersize == 100000 See the OpenVLA GitHub README for instructions on how to run and evaluate this model in the LIBERO simulator.

Open weights mit 7.5B parameters transformers

Model · Image and text to text

openvla-7b-finetuned-libero-10

OpenVLA Collaboration

This model was produced by fine-tuning the OpenVLA 7B model via LoRA (r=32) on the LIBERO-10 (LIBERO-Long) dataset from the LIBERO simulation benchmark. We made a few modifications to the training dataset to improve final performance (see the OpenVLA paper for details). Below are the hyperparameters we used for all LIBERO experiments: - No gradient accumulation (i.e. gradaccumulationsteps == 1) - shufflebuffersize == 100000 See the OpenVLA GitHub README for instructions on how to run and evaluate this model in the LIBERO simulator.

Open weights mit 7.5B parameters transformers

This model was produced by fine-tuning the OpenVLA 7B model via LoRA (r=32) on the LIBERO-Goal dataset from the LIBERO simulation benchmark. We made a few modifications to the training dataset to improve final performance (see the OpenVLA paper for details). Below are the hyperparameters we used for all LIBERO experiments: - No gradient accumulation (i.e. gradaccumulationsteps == 1) - shufflebuffersize == 100000 See the OpenVLA GitHub README for instructions on how to run and evaluate this model in the LIBERO simulator.

Open weights mit 7.5B parameters transformers

Model · Image and text to text

Huihui-Qwen3.6-27B-abliterated-AWQ-MTP

Shawn Wei

This is an uncensored version of Qwen/Qwen3.6-27B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. - AWQ Marlin kernel supported (auto-converted by vLLM at runtime) - MTP speculative decoding supported out of the box - 110+ tok/s on a single A800 80GB (vLLM 0.21.0, MTP enabled, fp8 KV cache) - Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated…

Open weights apache-2.0 6.3B parameters 262,144 tokens transformers

Model · Image and text to text

Qwen2-VL-7B-Instruct-AWQ

Qwen

We're excited to unveil Qwen2-VL, the latest iteration of our Qwen-VL model, representing nearly a year of innovation. SoTA understanding of images of various resolution & ratio: Qwen2-VL achieves state-of-the-art performance on visual understanding benchmarks, including MathVista, DocVQA, RealWorldQA, MTVQA, etc. Understanding videos of 20min+: Qwen2-VL can understand videos over 20 minutes for high-quality video-based question answering, dialog, content creation, etc. Agent that can operate your mobiles, robots, etc.: with the abilities of complex reasoning and decision making, Qwen2-VL can be integrated with devices like mobile phones, robots, etc., for automatic operation based on…

Open weights apache-2.0 8.3B parameters 32,768 tokens transformers