Downloads · 30 days
0
llama-3.1-8b-alpaca-qlora
himanshunakrani9/llama-3.1-8b-alpaca-qlora
llama-3.1-8b-alpaca-qlora is a machine learning model from himanshunakrani9. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
QLoRA fine-tune (rank=16, alpha=32) of meta-llama/Meta-Llama-3.1-8B-Instruct on yahma/alpaca-cleaned — 1 epochs, final loss 0.9306, 62.1 min on MI300X.
Access
Public
Updated Apr 18, 2026
Repo size
185 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors168 MB · 91%
At a glance
- Access
- Public
- Created
- Apr 18, 2026
- Updated
- Apr 18, 2026
- SHA
- f7c4b9b1
Model card
From the Hugging Face model README
Llama-3.1-8B Alpaca QLoRA (P1, MI300X bootcamp)
QLoRA fine-tune (rank=16, alpha=32) of meta-llama/Meta-Llama-3.1-8B-Instruct on yahma/alpaca-cleaned — 1 epochs, final loss 0.9306, 62.1 min on MI300X.
Details
- Base model:
meta-llama/Meta-Llama-3.1-8B-Instruct - LoRA rank: 16
- Epochs: 1
- Effective batch size: 16
- Learning rate: 0.0002
- Final train loss: 0.9306
Trained as part of the MI300X 50-hour fine-tuning bootcamp.
- Created
- Apr 18, 2026
- Updated
- Apr 18, 2026