Downloads · 30 days
22
8% of all-time downloads
Llama-3.1-Instruct_NSFW-pretrained_e1
athirdpath/Llama-3.1-Instruct_NSFW-pretrained_e1
Llama-3.1-Instruct_NSFW-pretrained_e1 is a text generation model from athirdpath. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
Llama 3.1 Instruct, continually pretrained with a full epoch (1169 steps @ total batch 115) of the same 1.5gb private dataset that underpins Iambe
All-time downloads
282
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3.1
- Model type
- llama
- Access
- Public
- Created
- Jul 30, 2024
- Updated
- Jul 30, 2024
- SHA
- dd9fc5a3
Try a prompt
Model card
From the Hugging Face model README
Llama 3.1 Instruct, continually pretrained with a full epoch (1169 steps @ total batch 115) of the same 1.5gb private dataset that underpins Iambe
Instruction is broken, needs to be reSFT'd
Why do this? I have a niche use case where I cannot increase compute over 8b, and L3/3.1 are the only models in this size category that meet my needs for logic. However, both versions of L3/3.1 have the damn repetition/token overconfidence problem, and this is meant to disrupt that certainty without disrupting the model's ability to function.
By the way, I think it's the lm_head that is causing the looping, but it might be the embeddings being too separated. I'm not going to pay two more times to test them separately, however :p
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3.1
- Created
- Jul 30, 2024
- Updated
- Jul 30, 2024