Skip to page content
SAVRN
Search Plan a project

Open-weight model

RK3576-LLM-Qwen3.5-2B

by RKNNAI RKNNAI/RK3576-LLM-Qwen3.5-2B

RK3576-LLM-Qwen3.5-2B is an open-weight model from RKNNAI, released under Apache License 2.0. Its published files total 15.6 GB.

This repository provides RKLLM deployment configurations of Qwen3.5-2B for RK3576. From the directory where you ran the download command, enter the configuration directory and verify: All entries must report OK before deployment.

Parameters—
Context—
Weights15.6 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By RKNNAI, published under apache-2.0, revision 1f81b3581085.

This repository provides RKLLM deployment configurations of Qwen3.5-2B for RK3576. From the directory where you ran the download command, enter the configuration directory and verify: All entries must report OK before deployment. - Supported chips are listed per configuration above. - Use the matching files from the same configuration. The source model is Qwen/Qwen3.5-2B, licensed under the Apache License 2.0. See LICENSE. Original copyright notices are retained in the license file. This distribution converts and quantizes the language model to RKLLM format for RK3576.

Read RKNNAI's full model card

Qwen3.5-2B

English | 简体中文

1. Model Introduction

This repository provides RKLLM deployment configurations of Qwen3.5-2B for RK3576.

Field Value
Model ID RKNNAI/RK3576-LLM-Qwen3.5-2B
Display Name RK3576-LLM-Qwen3.5-2B
Source Model Qwen/Qwen3.5-2B
Model Type LLM

Available Models

Configuration Supported Chips RKLLM Runtime Version Quantization NPU Cores Context
Qwen3.5-2B-w4a16-2-1024 RK3576 v1.2.4 w4a16 2 1024 (1k)
Qwen3.5-2B-w4a16-2-2048 RK3576 v1.2.4 w4a16 2 2048 (2k)
Qwen3.5-2B-w4a16-2-4096 RK3576 v1.2.4 w4a16 2 4096 (4k)
Qwen3.5-2B-w8a8-2-1024 RK3576 v1.2.4 w8a8 2 1024 (1k)
Qwen3.5-2B-w8a8-2-2048 RK3576 v1.2.4 w8a8 2 2048 (2k)
Qwen3.5-2B-w8a8-2-4096 RK3576 v1.2.4 w8a8 2 4096 (4k)

2. Files

Path Description
README.md English documentation
README_CN.md Chinese documentation
LICENSE Apache License 2.0
Qwen3.5-2B-w4a16-2-1024/ Deployment configuration
Qwen3.5-2B-w4a16-2-2048/ Deployment configuration
Qwen3.5-2B-w4a16-2-4096/ Deployment configuration
Qwen3.5-2B-w8a8-2-1024/ Deployment configuration
Qwen3.5-2B-w8a8-2-2048/ Deployment configuration
Qwen3.5-2B-w8a8-2-4096/ Deployment configuration

3. Download

ModelScope

Full repository:

modelscope download --model RKNNAI/RK3576-LLM-Qwen3.5-2B --revision v1.2.4 --local_dir ./RK3576-LLM-Qwen3.5-2B

Selected configuration and root documents:

from modelscope import snapshot_download

snapshot_download(
    "RKNNAI/RK3576-LLM-Qwen3.5-2B",
    revision="v1.2.4",
    allow_patterns=["README.md", "README_CN.md", "LICENSE", "Qwen3.5-2B-w4a16-2-1024/**"],
    local_dir="./RK3576-LLM-Qwen3.5-2B",
)

Hugging Face

Full repository:

hf download RKNNAI/RK3576-LLM-Qwen3.5-2B --revision v1.2.4 --local-dir ./RK3576-LLM-Qwen3.5-2B

Selected configuration and root documents:

hf download RKNNAI/RK3576-LLM-Qwen3.5-2B --revision v1.2.4 --local-dir ./RK3576-LLM-Qwen3.5-2B --include README.md README_CN.md LICENSE 'Qwen3.5-2B-w4a16-2-1024/**'

4. SHA-256 Verification

From the directory where you ran the download command, enter the configuration directory and verify:

cd ./RK3576-LLM-Qwen3.5-2B/Qwen3.5-2B-w4a16-2-1024
sha256sum -c SHA256SUMS

All entries must report OK before deployment.

5. Compatibility and Limitations

  • Supported chips are listed per configuration above.
  • Use the matching files from the same configuration.

6. Copyright and License

The source model is Qwen/Qwen3.5-2B, licensed under the Apache License 2.0. See LICENSE. Original copyright notices are retained in the license file.

This distribution converts and quantizes the language model to RKLLM format for RK3576.

Identity and Version

Repository
RKNNAI/RK3576-LLM-Qwen3.5-2B
Publisher
RKNNAI
Task
Not stated by the source
Modality
Other
Library
Not stated by the source
Parameters
Not stated by the source
Languages
Not stated by the source
Revision
1f81b3581085eba0b699821b58aa476008541c77
First published
2026-10-02
Last updated
2026-10-02

Files and Weights

34 files, 15.6 GB in total.

Configuration6 files · 5.0 KB
Documentation15 files · 38.3 KB
Other12 files · 15.6 GB
Repository1 file · 2.0 KB
Every file
FileTypeSizeSHA-256
Qwen3.5-2B-w4a16-2-1024/config.jsonConfiguration840 B —
Qwen3.5-2B-w4a16-2-2048/config.jsonConfiguration840 B —
Qwen3.5-2B-w4a16-2-4096/config.jsonConfiguration840 B —
Qwen3.5-2B-w8a8-2-1024/config.jsonConfiguration839 B —
Qwen3.5-2B-w8a8-2-2048/config.jsonConfiguration839 B —
Qwen3.5-2B-w8a8-2-4096/config.jsonConfiguration839 B —
LICENSEDocumentation11.3 KB —
Qwen3.5-2B-w4a16-2-1024/README.mdDocumentation1.8 KB —
Qwen3.5-2B-w4a16-2-1024/README_CN.mdDocumentation1.7 KB —
Qwen3.5-2B-w4a16-2-2048/README.mdDocumentation1.8 KB —
Qwen3.5-2B-w4a16-2-2048/README_CN.mdDocumentation1.7 KB —
Qwen3.5-2B-w4a16-2-4096/README.mdDocumentation1.8 KB —
Qwen3.5-2B-w4a16-2-4096/README_CN.mdDocumentation1.7 KB —
Qwen3.5-2B-w8a8-2-1024/README.mdDocumentation1.8 KB —
Qwen3.5-2B-w8a8-2-1024/README_CN.mdDocumentation1.7 KB —
Qwen3.5-2B-w8a8-2-2048/README.mdDocumentation1.8 KB —
Qwen3.5-2B-w8a8-2-2048/README_CN.mdDocumentation1.7 KB —
Qwen3.5-2B-w8a8-2-4096/README.mdDocumentation1.8 KB —
Qwen3.5-2B-w8a8-2-4096/README_CN.mdDocumentation1.7 KB —
README.mdDocumentation3.3 KB —
README_CN.mdDocumentation3.0 KB —
Qwen3.5-2B-w4a16-2-1024/Qwen3.5-2B.rkllmOther2.3 GB 95e271ac22eb
Qwen3.5-2B-w4a16-2-1024/SHA256SUMSOther316 B —
Qwen3.5-2B-w4a16-2-2048/Qwen3.5-2B.rkllmOther2.3 GB 93e2822d4c8a
Qwen3.5-2B-w4a16-2-2048/SHA256SUMSOther316 B —
Qwen3.5-2B-w4a16-2-4096/Qwen3.5-2B.rkllmOther2.3 GB c8191c0a0354
Qwen3.5-2B-w4a16-2-4096/SHA256SUMSOther316 B —
Qwen3.5-2B-w8a8-2-1024/Qwen3.5-2B.rkllmOther2.9 GB 3c8bfff49817
Qwen3.5-2B-w8a8-2-1024/SHA256SUMSOther316 B —
Qwen3.5-2B-w8a8-2-2048/Qwen3.5-2B.rkllmOther2.9 GB 2d9416c57bed
Qwen3.5-2B-w8a8-2-2048/SHA256SUMSOther316 B —
Qwen3.5-2B-w8a8-2-4096/Qwen3.5-2B.rkllmOther3.0 GB 1cb597000ea0
Qwen3.5-2B-w8a8-2-4096/SHA256SUMSOther316 B —
.gitattributesRepository2.0 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download from RKNNAI

Released by RKNNAI through its official repository on Hugging Face. Read the license.

Questions About RK3576-LLM-Qwen3.5-2B

Can I use RK3576-LLM-Qwen3.5-2B commercially?

Yes. RK3576-LLM-Qwen3.5-2B is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.