Downloads · 30 days
18
15% of all-time downloads
heathershaw/Llama-3.1-Spellbound-StoryWriter-8b-base-0.2-16-bit-rk3588-1.1.2
Llama-3.1-Spellbound-StoryWriter-8b-base-0.2-16-bit-rk3588-1.1.2 is a text generation model from heathershaw. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This version of Llama-3.1-Spellbound-StoryWriter-8b-base-0.2-16-bit has been converted to run on the RK3588 NPU using w8a8 quantization.
Downloads · 30 days
18
15% of all-time downloads
All-time downloads
119
Public
Repo size
8.6 GB
Likes
0
Public
Click a slice to open those files.
.rkllm8.6 GB · 100%
From the Hugging Face model README
This version of Llama-3.1-Spellbound-StoryWriter-8b-base-0.2-16-bit has been converted to run on the RK3588 NPU using w8a8 quantization.
This model has been optimized with the following LoRA:
Compatible with RKLLM version: 1.1.2
Pretty much anything by these folks: marty1885 and happyme531
Converted using https://github.com/heathershaw821/ez-er-rkllm-toolkit2
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.