Downloads · 30 days
25
20% of all-time downloads
Llama-3-Gamma-Twist
Blackroot/Llama-3-Gamma-Twist
Llama-3-Gamma-Twist is a text generation model from Blackroot. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
All-time downloads
124
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- May 6, 2024
- Updated
- May 6, 2024
- SHA
- 48ca7396
Try a prompt
Model card
From the Hugging Face model README
8B FP 16 weights
Prompt format is the same as Llama 3: https://llama.meta.com/docs/model-cards-and-prompt-formats/meta-llama-3/ Standard context length of 8192
This is a testing model trained on a custom 100MB dataset for 4 epochs geared for storytelling with a rolling context window, but might be good at other things too. There's significant evidence that the model is undertrained, longer training runs are baking now.
The dataset was constructed from cleaned long form dialogue, restructured, and then summarized with Llama-70B, and temporally stacked so that the summary of the past dialogue begins the next dialogue. Almost all samples were between 7500-8192 tokens long.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Featherless Ai
- live
- Created
- May 6, 2024
- Updated
- May 6, 2024