Downloads · 30 days
1
2% of all-time downloads
FydeOS/internlm2_rkLLM
internlm2_rkLLM is a machine learning model from FydeOS. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for rkllm. The card lists the license as apache-2.0.
Downloads · 30 days
1
2% of all-time downloads
All-time downloads
65
Public
Repo size
2.1 GB
Likes
0
Public
Click a slice to open those files.
.rkllm2.1 GB · 100%
From the Hugging Face model README
internlm2_rkLLM 是从 internlm2-chat-1_8b 转换而来的 RKLLM 模型,专为 Rockchip 设备优化。该模型运行于 RK3588 的 NPU 上。
书生·浦语-1.8B (InternLM2-1.8B) 是第二代浦语模型系列的18亿参数版本。通过在线 RLHF 在 InternLM2-Chat-1.8B-SFT 之上进一步对齐。 InternLM2-Chat-1.8B表现出更好的指令跟随、聊天体验和函数调用,推荐下游应用程序使用。
InternLM2 模型具备以下的技术特点:
此模型仅支持搭载 Rockchip RK3588/s 芯片的设备。请确认设备信息并确保 NPU 可用。
请确保你已将系统升级到最新版本。
XXX.rkllm。model/,将模型文件放置于该文件夹内。请确保已完成 RKLLM 的 NPU 相关内核更新。
XXX.rkllm。如遇到问题,请先查阅 issue 区,若问题仍未解决,再提交新的 issue。
本模型采用与 internlm2-chat-1_8b 相同的许可证。
如需更多信息,请联系:
internlm2_rkLLM is a RKLLM model derived from internlm2-chat-1_8b, specifically optimized for Rockchip devices. This model operates on the NPU of the RK3588 chip.
InternLM2-1.8B is the 1.8 billion parameter version of the second generation InternLM series. Further aligned on top of InternLM2-Chat-1.8B-SFT through online RLHF. InternLM2-Chat-1.8B exhibits better instruction following, chat experience, and function calling, which is recommended for downstream applications.
The InternLM2 has the following technical features:
This model is only supported on devices with the Rockchip RK3588/s chip. Please verify your device's chip information and ensure the NPU is operational.
Ensure you have upgraded to the latest version of openFyde.
XXX.rkllm.model/ and place the model file inside this folder.Ensure you have updated the NPU kernel related to RKLLM.
XXX.rkllm.If you encounter issues, please refer to the issue section first. If your problem remains unresolved, submit a new issue.
This model is licensed under the same terms as internlm2-chat-1_8b.
For more information, please contact: