Downloads · 30 days
7
4% of all-time downloads
llama2_7b_hf_LoRA_FT_merged_seq_len_256_wikitext2
dellaanima/llama2_7b_hf_LoRA_FT_merged_seq_len_256_wikitext2
llama2_7b_hf_LoRA_FT_merged_seq_len_256_wikitext2 is a text generation model from dellaanima. Use it when you need the model to write or continue text. It is set up for transformers.
- Validation Loss: 1.829 - Validation Perplexity: 6.584
All-time downloads
163
Public
Parameters
6.7B
27 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jun 11, 2024
- Updated
- Jun 11, 2024
- SHA
- 314b3b49
Try a prompt
Model card
From the Hugging Face model README
Model Performance
- Validation Loss: 1.829
- Validation Perplexity: 6.584
Model Configuration
- LoRA FT: Applied to
self_attn.q_projandself_attn.v_proj, Rank = 16 - Epochs: 3
- Learning Rate: 0.00001
- Batch Size: 8
- Sequence Length: 256
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jun 11, 2024
- Updated
- Jun 11, 2024