Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Rax 4.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency. Rax 4.5 features the following enhancement: For more details, please refer to our blog post Rax 4.5. WMT24++: a harder subset of WMT24 after difficulty labeling and rebalancing; we report the averaged scores on 55 languages using XCOMET-XXL. Empty cells (--) indicate scores not yet available or not…
Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance.
Runs On
What it takes to serve Qwen3.5-2B (2.3B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 4.5 GB | 5.5 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 2.3 GB | 2.7 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 1.1 GB | 1.4 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.
SAVRN's Notes on Qwen3.5-2B
We would size this one by its context window rather than its weights. The 2.3B parameters need 5.5 GB at 16-bit, 2.7 GB at 8-bit and 1.4 GB at 4-bit, so on the cheapest Index setup, one MI300X with 192 GB at $1.85 an hour on-demand, the weights take a sliver of the card and the 262,144-token context fills the rest. It takes images and text in and returns text, and the footprint buys many concurrent copies or one copy holding long inputs.
Apache 2.0 covers commercial use, modification and redistribution, with notices kept, significant changes stated and a patent grant included. Two checks: the page records a derivation from Qwen/Qwen3.5-2B-Base, so decide whether you want that base for your own post-training or this release, and no Index host prices it by the token yet, so the $1.85 hourly card is the number to run your volume against.
Model Card
By Qwen, published under apache-2.0, revision 15852e8c1636.
[!Note] This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.
These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.
In light of its parameter scale, the intended use cases are prototyping, task-specific fine-tuning, and other research or development purposes.
Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and efficiency.
Qwen3.5 Highlights
Qwen3.5 features the following enhancement:
Configuration
- Architecture
- Qwen3_5ForConditionalGeneration
- Context length (tokens)
- 262,144
- Layers
- 24
- Hidden size
- 2,048
- Feed-forward size
- 6,144
- Attention heads
- 8
- Key/value heads
- 2
- Head dimension
- 256
- Vocabulary size
- 248,320
- Model type
- qwen3_5
Identity and Version
- Repository
- Qwen/Qwen3.5-2B
- Publisher
- Qwen
- Task
- Image and text to text
- Modality
- Image and text
- Library
- transformers
- Parameters
- 2.3B parameters
- Languages
- Not stated by the source
- Revision
- 15852e8c16360a2fea060d615a32b45270f8a8fc
- First published
- 2026-02-28
- Last updated
- 2026-03-02
Files and Weights
13 files, 4.6 GB in total. The weights are 1 file totalling 4.5 GB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model.safetensors-00001-of-00001.safetensors | Weights | 4.5 GB | aa33250c4fc6 |
| config.json | Configuration | 2.9 KB | — |
| model.safetensors.index.json | Configuration | 64.5 KB | — |
| preprocessor_config.json | Configuration | 390 B | — |
| video_preprocessor_config.json | Configuration | 385 B | — |
| LICENSE | Documentation | 11.5 KB | — |
| README.md | Documentation | 62.8 KB | — |
| chat_template.jinja | Other | 7.8 KB | — |
| .gitattributes | Repository | 1.6 KB | — |
| merges.txt | Tokenizer | 3.4 MB | — |
| tokenizer.json | Tokenizer | 12.8 MB | 5f9e4d4901a9 |
| tokenizer_config.json | Tokenizer | 16.7 KB | — |
| vocab.json | Tokenizer | 6.7 MB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 4.5 GB
Released by Qwen through ModelScope. Read the license.
Built From
- Derived from Qwen/Qwen3.5-2B-Base
Evaluations
Each result is shown as reported, with the conditions its reporter stated. None is a SAVRN measurement. A comparison lines two results up only when their configuration, unit and setup are all stated and identical.
| Benchmark | Conditions | Result | Reported by | Revision | Date |
|---|---|---|---|---|---|
| Idavidrein/gpqa | Task diamondMetric diamondSetup GPQA DiamondComparison conditions not established | 44.9495 | EvalEval Reported by a third party |
Evaluated revision not stated | 2026-04-20 |
| LiquidAI/ifstruct-v1.0 | Task ifstruct_v1Metric ifstruct_v1Comparison conditions not established | 33.15 | Liquid AI — IFStruct v1.0 blog (Qwen3.5-2B) Reported by a third party |
Evaluated revision not stated | 2026-06-30 |
| MMMU/MMMU_Pro | Task mmmu_pro_visionMetric mmmu_pro_visionSetup ThinkingComparison conditions not established | 50.3 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-04-28 |
| TIGER-Lab/MMLU-Pro | Task mmlu_proMetric mmlu_proComparison conditions not established | 55.3 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-03-02 |
| likaixin/ScreenSpot-Pro | Task overallMetric overallComparison conditions not established | 54.5 | Model Card Reported by a third party |
Evaluated revision not stated | 2026-03-18 |
| llamaindex/ExtractBench | Task longMetric longSetup Pipeline name: qwen3_5_2b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 25.93 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-24 |
| llamaindex/ExtractBench | Task meanMetric meanSetup Pipeline name: qwen3_5_2b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 63.4 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-24 |
| llamaindex/ExtractBench | Task mediumMetric mediumSetup Pipeline name: qwen3_5_2b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 50.93 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-24 |
| llamaindex/ExtractBench | Task shortMetric shortSetup Pipeline name: qwen3_5_2b_vllm_extract_oneshot_structured_output_fileComparison conditions not established | 71.22 | ExtractBench Reported by a third party |
Evaluated revision not stated | 2026-08-24 |
| llamaindex/ParseBench | Task chartMetric chartSetup Pipeline name: qwen3_5_2b_vllm_layoutComparison conditions not established | 0.1 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| llamaindex/ParseBench | Task layoutMetric layoutSetup Pipeline name: qwen3_5_2b_vllm_layoutComparison conditions not established | 18.3 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| llamaindex/ParseBench | Task meanMetric meanSetup Pipeline name: qwen3_5_2b_vllm_layoutComparison conditions not established | 27.3 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| llamaindex/ParseBench | Task tableMetric tableSetup Pipeline name: qwen3_5_2b_vllm_layoutComparison conditions not established | 0 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| llamaindex/ParseBench | Task text_contentMetric text_contentSetup Pipeline name: qwen3_5_2b_vllm_layoutComparison conditions not established | 87.2 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
| llamaindex/ParseBench | Task text_formattingMetric text_formattingSetup Pipeline name: qwen3_5_2b_vllm_layoutComparison conditions not established | 31.1 | ParseBench Reported by a third party |
Evaluated revision not stated | 2026-04-22 |
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 4.5 GB |
| 16-bit | 4.5 GB |
| 8-bit | 2.3 GB |
| 4-bit | 1.1 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Built on This Model
- Derived fromdQwen3.5-2B-Base
- Derived fromQwen3.5-2B-auto-optimized
- Adapter ofdual-loop-qwen3.5-2b
- Derived fromdual-loop-qwen3.5-2b
- Quantized fromwag-2b
- Derived fromwag-2b
- Adapter ofweather-rescue-brazil-reader
- Derived fromweather-rescue-brazil-reader
- Adapter ofvnpen-writer-2b-v0.1-preview
- Derived fromvnpen-writer-2b-v0.1-preview
Compare Qwen3.5-2B
Questions About Qwen3.5-2B
How much GPU memory does Qwen3.5-2B need?
About 5.5 GB at 16-bit and 1.4 GB at 4-bit: the weights (2.3B parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run Qwen3.5-2B on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use Qwen3.5-2B commercially?
Yes. Qwen3.5-2B is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
What is Qwen3.5-2B's context length?
262,144 tokens, from the maximum position embeddings in its published configuration.
Similar Models
This is Qwen3.5-2B auto-optimized by Claude Fable for fast single-request text generation. Fable built and tuned the included qwen35fast inference engine while keeping Qwen's original BF16 weights unchanged. Across 12 development workloads, the Fable engine delivered 14× the decode speed of Transformers eager and 1.02× the speed of vLLM with MTP (geometric means). On 12 held-out workloads, it reached 528–866 tokens/s and 1.01× vLLM with MTP. Use Python 3.12 and an NVIDIA CUDA GPU. Download the model and install its dependencies: The original checkpoint also works with Transformers for Qwen's standard text and vision-language workflows; the speed figures above use qwen35fast. - Captured the…
We're excited to unveil Qwen2-VL, the latest iteration of our Qwen-VL model, representing nearly a year of innovation. SoTA understanding of images of various resolution & ratio: Qwen2-VL achieves state-of-the-art performance on visual understanding benchmarks, including MathVista, DocVQA, RealWorldQA, MTVQA, etc. Understanding videos of 20min+: Qwen2-VL can understand videos over 20 minutes for high-quality video-based question answering, dialog, content creation, etc. Agent that can operate your mobiles, robots, etc.: with the abilities of complex reasoning and decision making, Qwen2-VL can be integrated with devices like mobile phones, robots, etc., for automatic operation based on…
Model · Image and text to text
Qari-OCR-v0.3-VL-2B-Instruct
QARI-OCR v0.3 is a specialized vision-language model fine-tuned for Arabic Optical Character Recognition with a focus on structural document understanding. - Built on Qwen2-VL-2B-Instruct, this model excels at preserving document layouts, HTML tags, and formatting while transcribing Arabic text. - It is described in detail in the paper QARI-OCR: High-Fidelity Arabic Text Recognition through Multimodal Large Language Model Adaptation. While QARI v0.2 achieves better raw text accuracy (CER: 0.061), QARI v0.3 excels in: - HTML/Markdown structure preservation - Document layout understanding - Handwritten text recognition (initial capabilities) - 5x faster training than v0.2 You can load this…
Meet Qwen3-VL — the most powerful vision-language model in the Qwen series to date. This generation delivers comprehensive upgrades across the board: superior text understanding & generation, deeper visual perception & reasoning, extended context length, enhanced spatial and video dynamics comprehension, and stronger agent interaction capabilities. Available in Dense and MoE architectures that scale from edge to cloud, with Instruct and reasoning‑enhanced Thinking editions for flexible, on‑demand deployment. Text Understanding on par with pure LLMs: Seamless text–vision fusion for lossless, unified comprehension. 1. Interleaved-MRoPE: Full‑frequency allocation over time, width, and height…
This qwen3vl model was trained 2x faster with Unsloth and Huggingface's TRL library.
