Downloads · 30 days
21
4% of all-time downloads
Llama-3-LongStory
Blackroot/Llama-3-LongStory
Llama-3-LongStory is a text generation model from Blackroot. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
All-time downloads
552
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- May 6, 2024
- Updated
- May 6, 2024
- SHA
- ba32b034
Try a prompt
Model card
From the Hugging Face model README
8B FP 16 weights
Prompt format is the same as Llama 3: https://llama.meta.com/docs/model-cards-and-prompt-formats/meta-llama-3/ Standard context length of 8192
This model was trained on 100MB of long form stories for 8 epochs. This model was designed to do two tasks, continue a story given a summary of the previous events, and write 3k-8k length stories from a single prompt.
The dataset was constructed from cleaned long form dialogue, restructured, and then summarized with Llama-70B, and temporally stacked so that the summary of the past dialogue begins the next dialogue. Almost all samples were between 7500-8192 tokens long.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Featherless Ai
- live
- Created
- May 6, 2024
- Updated
- May 6, 2024