Downloads · 30 days
8
14% of all-time downloads
llama2_7b_hf_LoRA_FT_merged_seq_len_128_wikitext2
dellaanima/llama2_7b_hf_LoRA_FT_merged_seq_len_128_wikitext2
llama2_7b_hf_LoRA_FT_merged_seq_len_128_wikitext2 is a text generation model from dellaanima. Use it when you need the model to write or continue text. It is set up for transformers.
- Validation Loss: 1.984 - Validation Perplexity: 7.835
All-time downloads
56
Public
Parameters
6.7B
27 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jun 12, 2024
- Updated
- Jun 12, 2024
- SHA
- 7f8a8cba
Try a prompt
Model card
From the Hugging Face model README
Model Performance
- Validation Loss: 1.984
- Validation Perplexity: 7.835
Model Configuration
- LoRA FT: Applied to
self_attn.q_projandself_attn.v_proj, Rank = 16 - Epochs: 3
- Learning Rate: 0.00001
- Batch Size: 8
- Sequence Length: 128
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jun 12, 2024
- Updated
- Jun 12, 2024