Downloads · 30 days
14
29% of all-time downloads
koreallmdev/deepseek-r1-distill-llama-70b-canary1000-qlora-adapter
deepseek-r1-distill-llama-70b-canary1000-qlora-adapter is a text generation model from koreallmdev. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as mit.
PEFT LoRA adapter only. No 70B base weights or training dataset are included. Training: 1,000 rows, one epoch, 4-bit NF4 QLoRA, seq 1024, r=8, alpha=16. Smoke20: adapter 13 wins, base 5 wins, 2 ties, 0 errors. This Ca…
Downloads · 30 days
14
29% of all-time downloads
All-time downloads
48
Public
Repo size
432 MB
Likes
1
Public
Click a slice to open those files.
.safetensors414 MB · 96%
From the Hugging Face model README
PEFT LoRA adapter only. No 70B base weights or training dataset are included. Training: 1,000 rows, one epoch, 4-bit NF4 QLoRA, seq 1024, r=8, alpha=16. Smoke20: adapter 13 wins, base 5 wins, 2 ties, 0 errors. This Canary benchmark is not a comprehensive guarantee of executable-code correctness.