Downloads · 30 days
20
10% of all-time downloads
RKNNAI/RK182X-LLM-HY-MT1.5-1.8B
RK182X-LLM-HY-MT1.5-1.8B is a text generation model from RKNNAI. Use it when you need the model to write or continue text. The card lists the license as other.
Downloads · 30 days
20
10% of all-time downloads
All-time downloads
193
Public
Repo size
1.7 GB
Likes
0
Public
Click a slice to open those files.
.weight1.1 GB · 68%
From the Hugging Face model README
This repository provides an RKNN LLM model converted from tencent/HY-MT1.5-1.8B.
RKNNAI/RK182X-LLM-HY-MT1.5-1.8BRK182X-LLM-HY-MT1.5-1.8Bv1.1.0tencent/HY-MT1.5-1.8B| RKNN Runtime Version | Configuration Directory | Supported Chips | Quantization | NPU Cores | Context Length (tokens) | KVCache |
|---|---|---|---|---|---|---|
v1.1.0 | HY-MT1.5-1.8B-w4a16-8-8192 | RK1820, RK1828 | w4a16 | 8 | 8192 (8k) | fp16 |
| File or Directory | Description |
|---|---|
LICENSE | Source model license |
Notice | License, usage requirements, and attribution |
<configuration-directory>/ | Matching model files |
Subdirectory README.md | Configuration documentation (English) |
Subdirectory README_CN.md | Configuration documentation (Chinese) |
Subdirectory config.json | Model configuration and file manifest |
Subdirectory SHA256SUMS | SHA-256 checksums of the files in this directory (excluding this file) |
Download the full repository from ModelScope:
modelscope download --model RKNNAI/RK182X-LLM-HY-MT1.5-1.8B --revision v1.1.0 --local_dir ./RK182X-LLM-HY-MT1.5-1.8B
Download the full repository from Hugging Face:
hf download RKNNAI/RK182X-LLM-HY-MT1.5-1.8B --revision v1.1.0 --local-dir ./RK182X-LLM-HY-MT1.5-1.8B
Download a specific configuration from ModelScope:
from modelscope import snapshot_download
snapshot_download(
"RKNNAI/RK182X-LLM-HY-MT1.5-1.8B",
revision="v1.1.0",
allow_patterns=["README.md", "README_CN.md", "LICENSE", "Notice", "HY-MT1.5-1.8B-w4a16-8-8192/**"],
local_dir="./RK182X-LLM-HY-MT1.5-1.8B",
)
Download a specific configuration from Hugging Face:
hf download RKNNAI/RK182X-LLM-HY-MT1.5-1.8B --revision v1.1.0 --include "README.md" "README_CN.md" "LICENSE" "Notice" "HY-MT1.5-1.8B-w4a16-8-8192/**" --local-dir ./RK182X-LLM-HY-MT1.5-1.8B
Run in the configuration directory:
cd ./RK182X-LLM-HY-MT1.5-1.8B/HY-MT1.5-1.8B-w4a16-8-8192
sha256sum -c SHA256SUMS
Deploy only after all entries show OK.
rknn-smi -v before running.See LICENSE in the repository root for the source model license; The RKNN Toolkit and RKNN Runtime license terms also apply.
This release is an RKNN-converted/quantized derivative of the source model. The original license and attribution notices are retained; see Notice.
The source model uses TENCENT HY COMMUNITY LICENSE AGREEMENT, not Apache 2.0. Use and redistribution are subject to Section 5 and the appendix of LICENSE. Tencent is not affiliated with, sponsoring, or endorsing the publisher of this conversion. When providing services to others, disclose the actual service provider as required by the license terms.