Downloads · 30 days
63
14% of all-time downloads
RK182X-LLM-Qwen3-4B-Instruct-2507
RKNNAI/RK182X-LLM-Qwen3-4B-Instruct-2507
RK182X-LLM-Qwen3-4B-Instruct-2507 is a text generation model from RKNNAI. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
All-time downloads
451
Public
Repo size
3.3 GB
Likes
1
Trending 1
Repo makeup
Click a slice to open those files.
.weight4.9 GB · 74%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Sep 24, 2026
- Updated
- Sep 28, 2026
- SHA
- 9e4c0201
Try a prompt
Base models
Model card
From the Hugging Face model README
RK182X-LLM-Qwen3-4B-Instruct-2507
1. Model Overview
This repository provides an RKNN LLM model converted from Qwen/Qwen3-4B-Instruct-2507.
- Model ID:
RKNNAI/RK182X-LLM-Qwen3-4B-Instruct-2507 - Model Display Name:
RK182X-LLM-Qwen3-4B-Instruct-2507 - RKNN Runtime Version:
v1.1.0 - Source Model:
Qwen/Qwen3-4B-Instruct-2507 - Model Type: LLM
- Chip Label: RK182X
- Supported Chips: RK1828
Available Models
| RKNN Runtime Version | Configuration Directory | Supported Chips | Quantization | NPU Cores | Context Length (tokens) | KVCache |
|---|---|---|---|---|---|---|
v1.1.0 | Qwen3-4B-Instruct-2507-w4a16-8-16896 | RK1828 | w4a16 | 8 | 16896 (16.5k) | fp16 |
v1.1.0 | Qwen3-4B-Instruct-2507-w4a16-8-39424-kv-int4 | RK1828 | w4a16 | 8 | 39424 (38.5k) | int4 |
2. Files
| File or Directory | Description |
|---|---|
LICENSE | Source model license |
<configuration-directory>/ | Matching model files |
Subdirectory README.md | Configuration documentation (English) |
Subdirectory README_CN.md | Configuration documentation (Chinese) |
Subdirectory config.json | Model configuration and file manifest |
Subdirectory SHA256SUMS | SHA-256 checksums of the files in this directory (excluding this file) |
3. Download
Download the full repository from ModelScope:
modelscope download --model RKNNAI/RK182X-LLM-Qwen3-4B-Instruct-2507 --revision v1.1.0 --local_dir ./RK182X-LLM-Qwen3-4B-Instruct-2507
Download the full repository from Hugging Face:
hf download RKNNAI/RK182X-LLM-Qwen3-4B-Instruct-2507 --revision v1.1.0 --local-dir ./RK182X-LLM-Qwen3-4B-Instruct-2507
Download a specific configuration from ModelScope:
from modelscope import snapshot_download
snapshot_download(
"RKNNAI/RK182X-LLM-Qwen3-4B-Instruct-2507",
revision="v1.1.0",
allow_patterns=["README.md", "README_CN.md", "LICENSE", "Qwen3-4B-Instruct-2507-w4a16-8-16896/**"],
local_dir="./RK182X-LLM-Qwen3-4B-Instruct-2507",
)
Download a specific configuration from Hugging Face:
hf download RKNNAI/RK182X-LLM-Qwen3-4B-Instruct-2507 --revision v1.1.0 --include "README.md" "README_CN.md" "LICENSE" "Qwen3-4B-Instruct-2507-w4a16-8-16896/**" --local-dir ./RK182X-LLM-Qwen3-4B-Instruct-2507
4. SHA-256 Verification
Run in the configuration directory:
cd ./RK182X-LLM-Qwen3-4B-Instruct-2507/Qwen3-4B-Instruct-2507-w4a16-8-16896
sha256sum -c SHA256SUMS
Deploy only after all entries show OK.
5. Compatibility and Limitations
- Supported Chips: RK1828.
- Use the matching RKNN Runtime and driver. Check the device-side version with
rknn-smi -vbefore running. - Use the files from the selected configuration directory together.
6. Copyright and License
See LICENSE in the repository root for the source model license; The RKNN Toolkit and RKNN Runtime license terms also apply.
- Task
- Text Generation
- License
- apache-2.0
- Created
- Sep 24, 2026
- Updated
- Sep 28, 2026