Downloads · 30 days
11
11% of all-time downloads
aloobun/llama2-7b-guanaco
llama2-7b-guanaco is a text generation model from aloobun. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a Llama-2-7b-chat-hf model fine-tuned using QLoRA (4-bit precision) on the mlabonne/guanaco-llama2-1k dataset(a subset of OpenAssistant/oasst1).
Downloads · 30 days
11
11% of all-time downloads
All-time downloads
98
Public
Repo size
13.5 GB
Likes
0
Public
Click a slice to open those files.
.bin13.5 GB · 100%
From the Hugging Face model README
This is a Llama-2-7b-chat-hf model fine-tuned using QLoRA (4-bit precision) on the mlabonne/guanaco-llama2-1k dataset(a subset of OpenAssistant/oasst1).
This model was trained on a single A100.
{'train_runtime': 2368.6484, 'train_samples_per_second': 4.157, 'train_steps_per_second': 1.039, 'train_loss': 1.3207073250405679, 'epoch': 1.0}
This model was finetuned primarily for educational purposes.