Downloads · 30 days
0
llama-2-7b-chat-alpaca
ojas-kool/llama-2-7b-chat-alpaca
llama-2-7b-chat-alpaca is a machine learning model from ojas-kool. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This notebook guides through fine-tuning a pre-trained language model from the Hugging Face model hub on the "Alpaca" dataset using the Transformer library. Originally trained on "Llama" data, the goal is to make the…
Access
Public
Updated Apr 11, 2024
Repo size
135 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors134 MB · 98%
At a glance
- Access
- Public
- Created
- Apr 11, 2024
- Updated
- Apr 11, 2024
- SHA
- 45bcb532
Model card
From the Hugging Face model README
This notebook guides through fine-tuning a pre-trained language model from the Hugging Face model hub on the "Alpaca" dataset using the Transformer library. Originally trained on "Llama" data, the goal is to make the model generate suitable responses for the Alpaca dataset.
- Installed necessary packages (
transformers,accelerate,peft,bitsandbytes,trl). - Loads the "Alpaca" dataset using
load_dataset. - Defines a base language model (
NousResearch/Llama-2-7b-chat-hf) and sets training parameters. - Fine-tunes the model on the "Alpaca" dataset using
SFTTrainer. - Shows the model's text generation capability by providing prompts and generating responses.
- Saves the fine-tuned model and tokenizer locally for later use.
- Pushes the saved model to the Hugging face model hub for wider access.
- Created
- Apr 11, 2024
- Updated
- Apr 11, 2024