Downloads · 30 days
17
3% of all-time downloads
marianbasti/Llama-2-13b-fp16-alpaca-spanish
Llama-2-13b-fp16-alpaca-spanish is a text generation model from marianbasti. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
This is a LoRA for Llama 2 13B trained on a translated alpaca dataset on an attempt to improve spanish performance of the Llama-2 foundation model with a conversational focus.
Downloads · 30 days
17
3% of all-time downloads
All-time downloads
664
Public
Repo size
52.1 GB
Likes
1
Public
Click a slice to open those files.
.bin26 GB · 100%
From the Hugging Face model README
This is a LoRA for Llama 2 13B trained on a translated alpaca dataset on an attempt to improve spanish performance of the Llama-2 foundation model with a conversational focus.
Base model used was The Bloke's Llama-2-13B-fp16 trained in 4bit precision with an added padding token.
| Training parameteres | |
|---|---|
| LoRA scale | 2 |
| Epochs | 0.75 |
| Learning Rate | 2e-5 |
| Warmup Steps | 100 |
| Loss | 1.07 |