Downloads · 30 days
24
30% of all-time downloads
Llama-3-8B-Instruct-DADA
Envoid/Llama-3-8B-Instruct-DADA
Llama-3-8B-Instruct-DADA is a text generation model from Envoid. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
All-time downloads
79
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Apr 21, 2024
- Updated
- Apr 24, 2024
- SHA
- 14b311f2
Try a prompt
Model card
From the Hugging Face model README
Llama-3-8B-Instruct-DADA
Warning: This model is experimental and thus potentially unpredictable.
This model employs the same strategy as Mixtral Instruct ITR DADA
I trained Llama-3-8B-Instruct on the Alpaca-DADA dataset for 10 epochs at 1e-6 learning rate. I then did a 50/50 SLERP merge of the resulting model back onto Llama-3-8B-Instruct
This model may require custom stopping strings to tame due to current issues surrounding Llama-3 EOS tokens and various back-ends. It certainly gives some interesting answers using an assistant template/card in SillyTavern, though.
The below answer is one of the more interesting answers I've gotten out of an LLM on the same query, although there was an indentiation error (indicated by the red circle)
Training was done using qlora-pipe
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Created
- Apr 21, 2024
- Updated
- Apr 24, 2024