Downloads · 30 days
19
11% of all-time downloads
tinyllama-v1-rk3588
Pelochus/tinyllama-v1-rk3588
tinyllama-v1-rk3588 is a machine learning model from Pelochus. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for rkllm.
This is a conversion from https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0 to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
All-time downloads
170
Public
Repo size
2.3 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.rkllm1.2 GB · 100%
At a glance
- Library
- rkllm
- Access
- Public
- Created
- Apr 11, 2024
- Updated
- May 11, 2024
- SHA
- e73b1237
Model card
From the Hugging Face model README
TinyLlama v1.0 Chat for RK3588
This is a conversion from https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0 to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
Latest update: 11th May 2024. Converted with RKLLM runtime 1.0.1.
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
Same as the original LLM, in this case Apache 2.0:
- Library
- rkllm
- Created
- Apr 11, 2024
- Updated
- May 11, 2024