Downloads · 30 days
22
7% of all-time downloads
llama2-miniguanaco
zeyadusf/llama2-miniguanaco
llama2-miniguanaco is a text generation model from zeyadusf. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
Llama 2 is a state-of-the-art large language model (LLM) developed by Meta AI, designed for a variety of natural language processing (NLP) tasks. Its architecture builds upon transformer-based models, leveraging massi…
All-time downloads
326
Public
Repo size
8.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors134 MB · 98%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Sep 10, 2024
- Updated
- Sep 23, 2024
- SHA
- 47d96034
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Abstract
Llama 2 is a state-of-the-art large language model (LLM) developed by Meta AI, designed for a variety of natural language processing (NLP) tasks. Its architecture builds upon transformer-based models, leveraging massive text corpora during pretraining to develop rich language understanding capabilities. Fine-tuning Llama 2 can be customized to a specific task by using a smaller, task-specific dataset, often resulting in a specialized model that outperforms the general-purpose base model on that task. In this project, we fine-tune the Llama-2-7b-hf model using a subset of the Guanaco dataset, focusing on developing a highly efficient model called "MiniGuanaco."
Project Overview
This repository demonstrates the steps and code required to fine-tune Llama 2 for specific tasks. Using the Hugging Face model NousResearch/Llama-2-7b-hf as the base, the model is fine-tuned with the dataset mlabonne/guanaco-llama2-1k. The fine-tuned model is saved under the name llama2-miniguanaco.
You can access more information through:
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Sep 10, 2024
- Updated
- Sep 23, 2024