SAVRN
Search Contact SAVRN

Open-weight model · Text generation

Qwen-72B

by Qwen Qwen/Qwen-72B

通义千问-72B(Qwen-72B)是阿里云研发的通义千问大模型系列的720亿参数规模的模型。Qwen-72B是基于Transformer的大语言模型, 在超大规模的预训练数据上进行训练得到。预训练数据类型多样,覆盖广泛,包括大量网络文本、专业书籍、代码等。同时,在Qwen-72B的基础上,我们使用对齐机制打造了基于大语言模型的AI助手Qwen-72B-Chat。本仓库为Qwen-72B的仓库。 通义千问-72B(Qwen-72B)主要有以下特点: 1.

Parameters72.3B
Context32,768
Weights144.6 GB
Licenseother
AccessOpen weights
Monthly Downloads4M

Runs On

What it takes to serve Qwen-72B (72.3B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 144.6 GB 173.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x MI325X $2.00 · 1x MI355X $2.59
8-bit 72.3 GB 86.7 GB 1x MI300X (192 GB)
Vultr
$1.85 1x MI325X $2.00 · 1x MI355X $2.59
4-bit 36.1 GB 43.4 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

通义千问-72B(Qwen-72B)是阿里云研发的通义千问大模型系列的720亿参数规模的模型。Qwen-72B是基于Transformer的大语言模型, 在超大规模的预训练数据上进行训练得到。预训练数据类型多样,覆盖广泛,包括大量网络文本、专业书籍、代码等。同时,在Qwen-72B的基础上,我们使用对齐机制打造了基于大语言模型的AI助手Qwen-72B-Chat。本仓库为Qwen-72B的仓库。 通义千问-72B(Qwen-72B)主要有以下特点: 1. 大规模高质量训练语料:使用超过3万亿tokens的数据进行预训练,包含高质量中、英、多语言、代码、数学等数据,涵盖通用及专业领域的训练语料。通过大量对比实验对预训练语料分布进行了优化。 2. 强大的性能:Qwen-72B在多个中英文下游评测任务上(涵盖常识推理、代码、数学、翻译等),效果显著超越现有的开源模型。具体评测结果请详见下文。 3. 覆盖更全面的词表:相比目前以中英词表为主的开源模型,Qwen-72B使用了约15万大小的词表。该词表对多语言更加友好,方便用户在不扩展词表的情况下对部分语种进行能力增强和扩展。 4. 较长的上下文支持:Qwen-72B支持32k的上下文长度。 Qwen-72B is the 72B-parameter version of the large language model series, Qwen (abbr. Tongyi Qianwen), proposed by Alibaba Cloud. Qwen-72B is a Transformer-based large…

Excerpt from the card by Qwen, licensed other.

Configuration

Architecture
QWenLMHeadModel
Context length (tokens)
32,768
Layers
80
Hidden size
8,192
Feed-forward size
49,152
Attention heads
64
Vocabulary size
152,064
RoPE base
1,000,000
Model type
qwen

Identity and Version

Repository
Qwen/Qwen-72B
Publisher
Qwen
Task
Text generation
Modality
Text
Library
transformers
Parameters
72.3B parameters
Languages
zh, en
Revision
b8e18ac61df64d35308695769ff46b976b6a00f4
First published
2023-11-26
Last updated
2024-10-09

Files and Weights

103 files, 144.6 GB in total. The weights are 82 files totalling 144.6 GB in safetensors.

Weights82 files · 144.6 GB
Configuration9 files · 133.8 KB
Tokenizer4 files · 2.7 MB
Documentation3 files · 41.0 KB
Other4 files · 211.5 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model-00001-of-00082.safetensorsWeights2.5 GB 0b78ee20c52b
model-00002-of-00082.safetensorsWeights1.7 GB 02bf377c7bcf
model-00003-of-00082.safetensorsWeights1.7 GB 40907288644d
model-00004-of-00082.safetensorsWeights1.7 GB b3e3f62cbe8f
model-00005-of-00082.safetensorsWeights1.7 GB 7a1c42a60428
model-00006-of-00082.safetensorsWeights1.7 GB 0c12658ed8b3
model-00007-of-00082.safetensorsWeights1.7 GB 751273ae27cd
model-00008-of-00082.safetensorsWeights1.7 GB 350572818846
model-00009-of-00082.safetensorsWeights1.7 GB b9b548e1922b
model-00010-of-00082.safetensorsWeights1.7 GB 76f16336c29b
model-00011-of-00082.safetensorsWeights1.7 GB d29b3a6cf8b3
model-00012-of-00082.safetensorsWeights1.7 GB 8045521fc95b
model-00013-of-00082.safetensorsWeights1.7 GB cb8615b845f6
model-00014-of-00082.safetensorsWeights1.7 GB b7c7ea4e7e2e
model-00015-of-00082.safetensorsWeights1.7 GB c201c3ca71b2
model-00016-of-00082.safetensorsWeights1.7 GB fe85f55f1667
model-00017-of-00082.safetensorsWeights1.7 GB e6575a40ace3
model-00018-of-00082.safetensorsWeights1.7 GB ed694a7e792b
model-00019-of-00082.safetensorsWeights1.7 GB 256ccda66544
model-00020-of-00082.safetensorsWeights1.7 GB 616bec573870
model-00021-of-00082.safetensorsWeights1.7 GB b1602b5003fc
model-00022-of-00082.safetensorsWeights1.7 GB 75b7178fd929
model-00023-of-00082.safetensorsWeights1.7 GB b9cf968f7a6d
model-00024-of-00082.safetensorsWeights1.7 GB b032889a5003
model-00025-of-00082.safetensorsWeights1.7 GB 5520809074d9
model-00026-of-00082.safetensorsWeights1.7 GB dbeb8d2f8b84
model-00027-of-00082.safetensorsWeights1.7 GB cf91b60f20eb
model-00028-of-00082.safetensorsWeights1.7 GB 2701e0322450
model-00029-of-00082.safetensorsWeights1.7 GB 4ca6761b06d1
model-00030-of-00082.safetensorsWeights1.7 GB 74d6558da847
model-00031-of-00082.safetensorsWeights1.7 GB c4e5a202e80c
model-00032-of-00082.safetensorsWeights1.7 GB fa46299fc82f
model-00033-of-00082.safetensorsWeights1.7 GB 580d5f5653cf
model-00034-of-00082.safetensorsWeights1.7 GB 653397358e07
model-00035-of-00082.safetensorsWeights1.7 GB 6478a69f28f7
model-00036-of-00082.safetensorsWeights1.7 GB a5cbbc3ca849
model-00037-of-00082.safetensorsWeights1.7 GB 8c67bab4c5bb
model-00038-of-00082.safetensorsWeights1.7 GB d09632827abe
model-00039-of-00082.safetensorsWeights1.7 GB da488f61fd7d
model-00040-of-00082.safetensorsWeights1.7 GB 2e8cf629905e
model-00041-of-00082.safetensorsWeights1.7 GB 7e99156529a9
model-00042-of-00082.safetensorsWeights1.7 GB e69d18f3969f
model-00043-of-00082.safetensorsWeights1.7 GB 27545bd2394a
model-00044-of-00082.safetensorsWeights1.7 GB a8a6ea449c4f
model-00045-of-00082.safetensorsWeights1.7 GB c922adbc48ea
model-00046-of-00082.safetensorsWeights1.7 GB c7b5b73a46e8
model-00047-of-00082.safetensorsWeights1.7 GB c9ec013f161c
model-00048-of-00082.safetensorsWeights1.7 GB 257732341f0c
model-00049-of-00082.safetensorsWeights1.7 GB 84511cd0b010
model-00050-of-00082.safetensorsWeights1.7 GB 8514300ad2d7
model-00051-of-00082.safetensorsWeights1.7 GB bb5f7fd32aab
model-00052-of-00082.safetensorsWeights1.7 GB cd5bed2581ce
model-00053-of-00082.safetensorsWeights1.7 GB 9268b11e4416
model-00054-of-00082.safetensorsWeights1.7 GB c382c1d86a27
model-00055-of-00082.safetensorsWeights1.7 GB f180fe2b8c9d
model-00056-of-00082.safetensorsWeights1.7 GB 490e4d0999c9
model-00057-of-00082.safetensorsWeights1.7 GB a09ab8fabfd7
model-00058-of-00082.safetensorsWeights1.7 GB 5f5ce5451626
model-00059-of-00082.safetensorsWeights1.7 GB f492c0ece179
model-00060-of-00082.safetensorsWeights1.7 GB 3c93fca9a5c5
model-00061-of-00082.safetensorsWeights1.7 GB 3394edf76946
model-00062-of-00082.safetensorsWeights1.7 GB 96bfea9d8b11
model-00063-of-00082.safetensorsWeights1.7 GB cd940aa43cd0
model-00064-of-00082.safetensorsWeights1.7 GB 6943a0442841
model-00065-of-00082.safetensorsWeights1.7 GB 2f1aeaf5a1ff
model-00066-of-00082.safetensorsWeights1.7 GB 306983ac6a6c
model-00067-of-00082.safetensorsWeights1.7 GB 51c7c0b89210
model-00068-of-00082.safetensorsWeights1.7 GB 8e1e6353ecba
model-00069-of-00082.safetensorsWeights1.7 GB b63cc7734dd8
model-00070-of-00082.safetensorsWeights1.7 GB 6229a186fff3
model-00071-of-00082.safetensorsWeights1.7 GB 7594dabca833
model-00072-of-00082.safetensorsWeights1.7 GB 6bdbd04c20bc
model-00073-of-00082.safetensorsWeights1.7 GB f706fc06ca96
model-00074-of-00082.safetensorsWeights1.7 GB 6bb4a9e046e3
model-00075-of-00082.safetensorsWeights1.7 GB b0604a722ff7
model-00076-of-00082.safetensorsWeights1.7 GB f86a992864e7
model-00077-of-00082.safetensorsWeights1.7 GB 09ec33e28656
model-00078-of-00082.safetensorsWeights1.7 GB 64e711d81b48
model-00079-of-00082.safetensorsWeights1.7 GB c2abda654f10
model-00080-of-00082.safetensorsWeights1.7 GB 514fef25c734
model-00081-of-00082.safetensorsWeights1.7 GB d320e425bbf0
model-00082-of-00082.safetensorsWeights2.5 GB cbf6116d9c62
config.jsonConfiguration941 B
configuration_qwen.pyConfiguration2.3 KB
cpp_kernels.pyConfiguration1.9 KB
generation_config.jsonConfiguration222 B
model.safetensors.index.jsonConfiguration48.6 KB
modeling_qwen.pyConfiguration55.6 KB
qwen_generation_utils.pyConfiguration14.6 KB
special_tokens_map.jsonConfiguration3 B
tokenization_qwen.pyConfiguration9.6 KB
LICENSEDocumentation6.9 KB
NOTICEDocumentation15.3 KB
README.mdDocumentation18.8 KB
assets/logo.jpgOther82.7 KB
assets/wechat.pngOther68.4 KB
cache_autogptq_cuda_256.cppOther8.4 KB
cache_autogptq_cuda_kernel_256.cuOther52.0 KB
.gitattributesRepository1.5 KB
assets/qwen_tokenizer.pngTokenizer80.9 KB
assets/tokenizer.pngTokenizer80.9 KB
qwen.tiktokenTokenizer2.6 MB
tokenizer_config.jsonTokenizer176 B

License and Download

License
other
Access
Open weights, no gate
Download size
144.6 GB
Download from Qwen

Released by Qwen through ModelScope. Read the license.

Built From

  • Described by arXiv:2309.16609

Memory Requirements

PrecisionWeights in memory
As published144.6 GB
16-bit144.6 GB
8-bit72.3 GB
4-bit36.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Compare Qwen-72B

Questions About Qwen-72B

How much GPU memory does Qwen-72B need?

About 173.5 GB at 16-bit and 43.4 GB at 4-bit: the weights (72.3B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run Qwen-72B on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What license is Qwen-72B released under?

other, as its publisher declares it. Read the license text before commercial use.

What is Qwen-72B's context length?

32,768 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

Llama-3.3-70B-Instruct

Meta Llama

The Meta Llama 3.3 multilingual large language model (LLM) is an instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks. Model Architecture: Llama 3.3 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety. Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and…

Access requested at publisher llama3.3 70.6B parameters transformers

For more details on how to deploy and use the model - see the Quick Start Guide below! The post-training data has a cutoff date of February 2026. The pre-training data has a cutoff date of June 2025. NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents. Nemotron-3-Super-120B-A12B-NVFP4 is a large language model (LLM) trained by NVIDIA, designed to deliver strong agentic, reasoning, and conversational capabilities. It is optimized for collaborative agents and high-volume workloads such as IT ticket automation. Like other models in the family, it responds to user queries and…

Open weights other 67.2B parameters 262,144 tokens transformers

Model · Text generation

Qwen3-Coder-Next-FP8

Qwen

Today, we're announcing Qwen3-Coder-Next-FP8, an open-weight language model designed specifically for coding agents and local development. It features the following key enhancements: Qwen3-Coder-Next-FP8 has the following features: NOTE: This model supports only non-thinking mode and does not generate blocks in its output. Meanwhile, specifying enablethinking=False is no longer required. For more details, including benchmark evaluation, hardware requirements, and inference performance, please refer to our blog, GitHub, and Documentation. We advise you to use the latest version of transformers. The following contains a code snippet illustrating how to use the model generate content based on…

Open weights apache-2.0 79.7B parameters 262,144 tokens transformers

Model · Text generation

Qwen3.5-122B-A10B-NVFP4

NVIDIA

The NVIDIA Qwen3.5-122B-A10B-NVFP4 model is the quantized version of Alibaba's Qwen3.5-122B-A10B model, which is an auto-regressive language model that uses an optimized transformer architecture. For more information, please check here. The NVIDIA Qwen3.5-122B-A10B NVFP4 model is quantized with Model Optimizer. This model is ready for commercial/non-commercial use. This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party’s requirements for this application and use case; see link to Non-NVIDIA (Qwen3.5-122B-A10B) Model Card from Alibaba. Global Developers looking to take off-the-shelf, pre-quantized models for deployment in AI Agent systems…

Open weights apache-2.0 64.6B parameters 262,144 tokens Model Optimizer

Model · Text generation

Qwen3.6-35B-A3B-abliterated-v4

CS

Uncensored version of Qwen/Qwen3.6-35B-A3B with refusal behavior removed via abliteration (norm-preserving orthogonalization). Zero refusals on harmful prompts. No false refusals on harmless prompts. Abliteration identifies the "refusal direction" in the model's residual stream — the linear direction that activates when the model decides to refuse — and surgically removes it from all output projection weights using norm-preserving orthogonalization. 1. Collect residual stream activations (last token position) for 512 harmful + 512 harmless prompts across all 40 layers 2. Compute mean difference vector per layer → this is the "refusal direction" candidate 3. Score layers by…

Open weights apache-2.0 34.7B parameters 262,144 tokens transformers

Model · Text generation

dolphin-2.9.1-yi-1.5-34b

Dolphin

Curated and trained by Eric Hartford, Lucas Atkins, and Fernando Fernandes, and Cognitive Computations This is our most spectacular outcome ever. FFT, all parameters, 16bit. 77.4 MMLU on 34b. And it talks like a dream. Although the max positional embeddings is 4k, we used rope theta of 1000000.0 and we trained with sequence length 8k. We plan to train on the upcoming 32k version as well. Our appreciation for the sponsors of Dolphin 2.9.1: - Crusoe Cloud - provided excellent on-demand 8xH100 node - OnDemand - provided inference sponsorship This model is based on Yi-1.5-34b, and is governed by apache 2.0 license. The base model has 4k context, but we used rope theta of 1000000.0 and the…

Open weights apache-2.0 34.4B parameters 8,192 tokens transformers