Downloads · 30 days
10
6% of all-time downloads
phi-3-mini-rk3588
Pelochus/phi-3-mini-rk3588
phi-3-mini-rk3588 is a machine learning model from Pelochus. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for rkllm.
This is a conversion from https://huggingface.co/microsoft/phi-3-mini-4k-instruct to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
All-time downloads
166
Public
Repo size
3.9 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.rkllm3.9 GB · 100%
At a glance
- Library
- rkllm
- Access
- Public
- Created
- May 9, 2024
- Updated
- May 11, 2024
- SHA
- 4e34eba2
Model card
From the Hugging Face model README
Microsoft's Phi-3 mini (4K instruct) for RK3588
This is a conversion from https://huggingface.co/microsoft/phi-3-mini-4k-instruct to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
Latest update: 9th May 2024. Converted with RKLLM runtime 1.0.1.
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
Same as the original LLM, in this case MIT:
- Library
- rkllm
- Created
- May 9, 2024
- Updated
- May 11, 2024