SAVRN
Search Contact SAVRN

Open-weight model · Text generation

Meta-Llama-3-8B-Instruct

by Meta Llama meta-llama/Meta-Llama-3-8B-Instruct

Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes.

Parameters8B
Context
Weights32.1 GB
Licensellama3
AccessAccess requested at publisher
Monthly Downloads1.2M

Runs On

What it takes to serve Meta-Llama-3-8B-Instruct (8B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 16.1 GB 19.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 8.0 GB 9.6 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.0 GB 4.8 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

SAVRN's Notes on Meta-Llama-3-8B-Instruct

Nineteen point three gigabytes is the number to plan around at 16-bit, 16.1 of that being weights. At 8-bit the need falls to 9.6 gigabytes; at 4-bit it is 4.8, small enough that the 192 gigabyte MI300X the Index lists as cheapest, at $1.85 an hour, is far more card than one copy needs. That headroom is the point: room to serve many sessions at once.

The Llama 3 Community License permits commercial use with conditions: attribution as Meta specifies, compliance with Meta's Acceptable Use Policy, and a separate license request for any licensee with more than 700 million monthly active users on the release date. Access is gated, so the files arrive only after the publisher approves you. Check the context length, which our record does not carry, and the age of the weights, released April 17, 2024 and last updated June 18, 2025.

Model Card

Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Further, in developing these models, we took great care to optimize helpfulness and safety. Model developers Meta Variations Llama 3 comes in two sizes — 8B and 70B parameters — in pre-trained and instruction tuned variants. Input Models input text only. Output Models generate text and code only. Model Architecture Llama 3 is an auto-regressive language…

Excerpt from the card by Meta Llama, licensed llama3.

Identity and Version

Repository
meta-llama/Meta-Llama-3-8B-Instruct
Publisher
Meta Llama
Task
Text generation
Modality
Text
Library
transformers
Parameters
8B parameters
Languages
en
Revision
8afb486c1db24fe5011ec46dfbe5b5dccdb575c2
First published
2024-04-17
Last updated
2025-06-18

Files and Weights

17 files, 32.1 GB in total. The weights are 5 files totalling 32.1 GB in pth, safetensors.

Weights5 files · 32.1 GB
Configuration5 files · 25.1 KB
Tokenizer3 files · 11.3 MB
Documentation3 files · 51.4 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00004.safetensorsWeights5.0 GB
model-00002-of-00004.safetensorsWeights5.0 GB
model-00003-of-00004.safetensorsWeights4.9 GB
model-00004-of-00004.safetensorsWeights1.2 GB
original/consolidated.00.pthWeights16.1 GB
config.jsonConfiguration654 B
generation_config.jsonConfiguration187 B
model.safetensors.index.jsonConfiguration23.9 KB
original/params.jsonConfiguration211 B
special_tokens_map.jsonConfiguration73 B
LICENSEDocumentation7.8 KB
README.mdDocumentation38.9 KB
USE_POLICY.mdDocumentation4.7 KB
.gitattributesRepository1.5 KB
original/tokenizer.modelTokenizer2.2 MB
tokenizer.jsonTokenizer9.1 MB
tokenizer_config.jsonTokenizer51.0 KB

License and Download

License
llama3
Access
Access requested at publisher
Download size
32.1 GB
Download from Meta Llama

Released by Meta Llama through Meta's Llama downloads.

Evaluations

Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.

BenchmarkConditionsResultReported byRevisionDate
TIGER-Lab/MMLU-Pro Task mmlu_proMetric mmlu_proComparison conditions not established 40.98 EvalEval
Reported by a third party
Evaluated revision not stated 2026-06-30

Memory Requirements

PrecisionWeights in memory
As published32.1 GB
16-bit16.1 GB
8-bit8.0 GB
4-bit4.0 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Built on This Model

Compare Meta-Llama-3-8B-Instruct

Questions About Meta-Llama-3-8B-Instruct

How much GPU memory does Meta-Llama-3-8B-Instruct need?

About 19.3 GB at 16-bit and 4.8 GB at 4-bit: the weights (8B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Meta-Llama-3-8B-Instruct on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use Meta-Llama-3-8B-Instruct commercially?

Yes, with conditions. Meta-Llama-3-8B-Instruct is released under Meta Llama 3 Community License. The Llama 3 Community License permits commercial use, except that a licensee whose products had more than 700 million monthly active users on the release date must request a license from Meta. It requires attribution as the license specifies and compliance with Meta's Acceptable Use Policy.

Similar Models

Model · Text generation

Llama-3.1-8B-Instruct

Meta Llama

The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes (text in/text out). The Llama 3.1 instruction tuned text only models (8B, 70B, 405B) are optimized for multilingual dialogue use cases and outperform many of the available open source and closed chat models on common industry benchmarks. Model Architecture: Llama 3.1 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.…

Access requested at publisher llama3.1 8B parameters transformers

Model · Text generation

Llama-3.1-8B-Instruct-4bit

MLX Community

The Model mlx-community/Llama-3.1-8B-Instruct-4bit was converted to MLX format from meta-llama/Llama-3.1-8B-Instruct using mlx-lm version 0.21.4.

Open weights llama3.1 8B parameters 131,072 tokens mlx

This is the 8B (high-capacity flagship) member of the Med-LLaMA3 family introduced in the paper “Med-LLaMA3: Advancing Medical Question-Answering Through Parameter-Efficient Fine-Tuning of Large Language Models” (Applied Sciences, 2026). The family adapts the LLaMA-3 architecture to the medical domain by training only a small fraction of the base model’s parameters (4.01% for this 8B variant), achieving strong medical question-answering performance while keeping the memory footprint low — enabling development and inference on low-cost, consumer-grade hardware. The 8B variant is the high-capacity model for complex clinical reasoning. It attains a mean accuracy of 75.71% across the eight MMLU…

Open weights llama3.1 8B parameters 131,072 tokens transformers

A Llama-3-8B-Instruct checkpoint compressed with SVD-LLM to 50.0% of dense parameters, then edited by 4 of 10 rounds of iterative parameter-neutral swap selected by the gapiter rule (up to 0.1% of dense parameters per round; the full run's budget is 1.0%). This is a research artifact from a study of how SVD compression damages safety behaviour and which component-selection rule best repairs it. It is one cell of a grid over selection rules and budgets; it is not a general-purpose chat model. This checkpoint exists to measure safety/utility trade-offs under compression. Several arms in the grid are deliberately safety-degraded relative to Llama-3-8B-Instruct: compression alone raises…

Open weights llama3 8B parameters 8,192 tokens transformers

A Llama-3-8B-Instruct checkpoint compressed with SVD-LLM to 50.0% of dense parameters, then edited by 3 of 10 rounds of iterative parameter-neutral swap selected by the gapiter rule (up to 0.1% of dense parameters per round; the full run's budget is 1.0%). This is a research artifact from a study of how SVD compression damages safety behaviour and which component-selection rule best repairs it. It is one cell of a grid over selection rules and budgets; it is not a general-purpose chat model. This checkpoint exists to measure safety/utility trade-offs under compression. Several arms in the grid are deliberately safety-degraded relative to Llama-3-8B-Instruct: compression alone raises…

Open weights llama3 8B parameters 8,192 tokens transformers

A Llama-3-8B-Instruct checkpoint compressed with SVD-LLM to 50.0% of dense parameters, then edited by 2 of 10 rounds of iterative parameter-neutral swap selected by the gapiter rule (up to 0.1% of dense parameters per round; the full run's budget is 1.0%). This is a research artifact from a study of how SVD compression damages safety behaviour and which component-selection rule best repairs it. It is one cell of a grid over selection rules and budgets; it is not a general-purpose chat model. This checkpoint exists to measure safety/utility trade-offs under compression. Several arms in the grid are deliberately safety-degraded relative to Llama-3-8B-Instruct: compression alone raises…

Open weights llama3 8B parameters 8,192 tokens transformers