llama2-7b-instruction-finetuned

ShubhamNair/llama2-7b-instruction-finetuned

llama2-7b-instruction-finetuned is a text generation model from ShubhamNair. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

10% of all-time downloads

All-time downloads

Public

Parameters

3.5B

11.8 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors3.9 GB · 100%

Parameter types

How the weights are stored.

U83.4B · 96%

Try a prompt

Base models

meta-llama/Llama-2-7b-hf

Model card

From the Hugging Face model README

llama2-7b-instruction-finetuned

This model is a fine-tuned version of meta-llama/Llama-2-7b-hf on the None dataset. It achieves the following results on the evaluation set:

Loss: 6.7451

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 3e-05
train_batch_size: 2
eval_batch_size: 8
seed: 42
gradient_accumulation_steps: 8
total_train_batch_size: 16
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 5
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss
No log	0.9412	4	6.7601
No log	1.8824	8	6.7517
7.6968	2.8235	12	6.7478
7.6968	4.0	17	6.7457
7.6823	4.7059	20	6.7451

Framework versions

Transformers 4.42.4
Pytorch 2.3.1+cu121
Datasets 2.20.0
Tokenizers 0.19.1

Task: Text Generation
Library: transformers
Type: llama
License: llama2
Created: Jul 22, 2024
Updated: Jul 22, 2024