Downloads · 30 days
6
21% of all-time downloads
Pritish92/open-llama-3b-v2-grit-alpaca
open-llama-3b-v2-grit-alpaca is a text generation model from Pritish92. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
This model is a fine-tuned version of openlm-research/openllama3bv2 using the GRIT (Gradient Regularized Instruction Tuning) algorithm and QLoRA on the Alpaca dataset.
Downloads · 30 days
6
21% of all-time downloads
All-time downloads
28
Public
Repo size
171 MB
Likes
0
Public
Click a slice to open those files.
.safetensors170 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of openlm-research/open_llama_3b_v2 using the GRIT (Gradient Regularized Instruction Tuning) algorithm and QLoRA on the Alpaca dataset.
The base model is quantized to 4-bit (NF4) to enable efficient fine-tuning.
accelerate for efficient training.In benchmark comparisons, GRIT has shown faster convergence and better stability than standard LoRA or fine-tuning, making it well-suited for efficient single-epoch training.
If you use this model, please cite:
@misc{grit-openllama-3b-alpaca,
title={OpenLlama 3B v2 Fine-tuned with GRIT on Alpaca},
author={Pritish92},
year={2025},
publisher={Hugging Face},
url={https://huggingface.co/Pritish92/open-llama-3b-v2-grit-alpaca}
}
This model inherits the Apache 2.0 license.