Downloads · 30 days
1
4% of all-time downloads
thanhtantran/GRPO-VI-Qwen2-3B-RAG-rk3588-1.2.0
GRPO-VI-Qwen2-3B-RAG-rk3588-1.2.0 is a machine learning model from thanhtantran. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This version of GRPO-VI-Qwen2-3B-RAG has been converted to run on the RK3588 NPU using w8a8 quantization.
Downloads · 30 days
1
4% of all-time downloads
All-time downloads
27
Public
Repo size
3.8 GB
Likes
0
Public
Click a slice to open those files.
.rkllm7.5 GB · 100%
From the Hugging Face model README
This version of GRPO-VI-Qwen2-3B-RAG has been converted to run on the RK3588 NPU using w8a8 quantization.
This model has been optimized with the following LoRA:
Compatible with RKLLM version: 1.2.0
Pretty much anything by these folks: marty1885 and happyme531
Converted using https://github.com/c0zaut/ez-er-rkllm-toolkit
AITeamVN/GRPO-VI-Qwen2-3B-RAG