Downloads · 30 days
9
19% of all-time downloads
Lyra-Gutenberg-12b-EXL2-8bpw
Statuo/Lyra-Gutenberg-12b-EXL2-8bpw
Lyra-Gutenberg-12b-EXL2-8bpw is a text generation model from Statuo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Mostly quanting this to try it out, didn't see any other quants for EXL2 on this so here we are.
All-time downloads
47
Public
Repo size
12.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors12.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Aug 30, 2024
- Updated
- Aug 30, 2024
- SHA
- 68c9fc8d
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Mostly quanting this to try it out, didn't see any other quants for EXL2 on this so here we are.
This is the 8bpw version of this model. Find the original here. <br> For the 6bpw version, go here <br> For the 4bpw version, go here <br>
mistral-nemo-gutenberg-12B-v4
Sao10K/MN-12B-Lyra-v1 finetuned on jondurbin/gutenberg-dpo-v0.1.
Method
Finetuned using an A100 on Google Colab for 3 epochs.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Aug 30, 2024
- Updated
- Aug 30, 2024