Downloads · 30 days
831
100% of all-time downloads
RKNNAI/RK182X-LLM-MiniCPM5-2B
RK182X-LLM-MiniCPM5-2B is a text generation model from RKNNAI. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Downloads · 30 days
831
100% of all-time downloads
All-time downloads
831
Public
Repo size
5.9 GB
Likes
1
Trending 1
Click a slice to open those files.
.weight7.9 GB · 73%
From the Hugging Face model README
This repository provides an RKNN LLM model converted from openbmb/MiniCPM5-2B.
RKNNAI/RK182X-LLM-MiniCPM5-2BRK182X-LLM-MiniCPM5-2Bv1.1.0openbmb/MiniCPM5-2B| RKNN Runtime Version | Configuration Directory | Supported Chips | Quantization | NPU Cores | Context Length (tokens) | KVCache |
|---|---|---|---|---|---|---|
v1.1.0 | MiniCPM5-2B-w4a16-8-13312-kv-int4 | RK1820, RK1828 | w4a16 | 8 | 13312 (13k) | int4 |
v1.1.0 | MiniCPM5-2B-w4a16-8-18432-normal | RK1828 | w4a16 | 8 | 18432 (18k) | fp16 |
v1.1.0 | MiniCPM5-2B-w4a16-8-48128-kv-int4 | RK1828 | w4a16 | 8 | 48128 (47k) | int4 |
v1.1.0 | MiniCPM5-2B-w4a16-8-5632 | RK1820, RK1828 | w4a16 | 8 | 5632 (5.5k) | fp16 |
v1.1.0 | MiniCPM5-2B-w8a16-8-14336-normal | RK1828 | w8a16 | 8 | 14336 (14k) | fp16 |
| File or Directory | Description |
|---|---|
LICENSE | Source model license |
Notice | License, usage requirements, and attribution |
<configuration-directory>/ | Matching model files |
Subdirectory README.md | Configuration documentation (English) |
Subdirectory README_CN.md | Configuration documentation (Chinese) |
Subdirectory config.json | Model configuration and file manifest |
Subdirectory SHA256SUMS | SHA-256 checksums of the files in this directory (excluding this file) |
Download the full repository from ModelScope:
modelscope download --model RKNNAI/RK182X-LLM-MiniCPM5-2B --revision v1.1.0 --local_dir ./RK182X-LLM-MiniCPM5-2B
Download the full repository from Hugging Face:
hf download RKNNAI/RK182X-LLM-MiniCPM5-2B --revision v1.1.0 --local-dir ./RK182X-LLM-MiniCPM5-2B
Download a specific configuration from ModelScope:
from modelscope import snapshot_download
snapshot_download(
"RKNNAI/RK182X-LLM-MiniCPM5-2B",
revision="v1.1.0",
allow_patterns=["README.md", "README_CN.md", "LICENSE", "Notice", "MiniCPM5-2B-w4a16-8-13312-kv-int4/**"],
local_dir="./RK182X-LLM-MiniCPM5-2B",
)
Download a specific configuration from Hugging Face:
hf download RKNNAI/RK182X-LLM-MiniCPM5-2B --revision v1.1.0 --include "README.md" "README_CN.md" "LICENSE" "Notice" "MiniCPM5-2B-w4a16-8-13312-kv-int4/**" --local-dir ./RK182X-LLM-MiniCPM5-2B
Run in the configuration directory:
cd ./RK182X-LLM-MiniCPM5-2B/MiniCPM5-2B-w4a16-8-13312-kv-int4
sha256sum -c SHA256SUMS
Deploy only after all entries show OK.
rknn-smi -v before running.See LICENSE in the repository root for the source model license; The RKNN Toolkit and RKNN Runtime license terms also apply.
This release is an RKNN-converted/quantized derivative of the source model. The original license and attribution notices are retained; see Notice.