Downloads · 30 days
22
12% of all-time downloads
Pelochus/llama2-chat-7b-hf-rk3588
llama2-chat-7b-hf-rk3588 is a machine learning model from Pelochus. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for rkllm.
This is a conversion from https://huggingface.co/meta-llama/Llama-2-7b-chat-hf to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
Downloads · 30 days
22
12% of all-time downloads
All-time downloads
186
Public
Repo size
6.9 GB
Likes
0
Public
Click a slice to open those files.
.rkllm6.9 GB · 100%
From the Hugging Face model README
This is a conversion from https://huggingface.co/meta-llama/Llama-2-7b-chat-hf to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
Latest update: April 2024. Converted with RKLLM runtime 1.0.0. Not compatible with newer versions
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
Same as the original LLM:
https://huggingface.co/meta-llama/Llama-2-7b-chat-hf/blob/main/LICENSE.txt