Downloads · 30 days
8
16% of all-time downloads
Lyra-Gutenberg-12b-EXL2-4bpw
Statuo/Lyra-Gutenberg-12b-EXL2-4bpw
Lyra-Gutenberg-12b-EXL2-4bpw is a text generation model from Statuo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Mostly quanting this to try it out, didn't see any other quants for EXL2 on this so here we are.
All-time downloads
50
Public
Repo size
7.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Aug 30, 2024
- Updated
- Aug 30, 2024
- SHA
- 5f746564
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Mostly quanting this to try it out, didn't see any other quants for EXL2 on this so here we are.
This is the 4bpw version of this model. Find the original here. <br> For the 8bpw version, go here <br> For the 6bpw version, go here <br>
mistral-nemo-gutenberg-12B-v4
Sao10K/MN-12B-Lyra-v1 finetuned on jondurbin/gutenberg-dpo-v0.1.
Method
Finetuned using an A100 on Google Colab for 3 epochs.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Aug 30, 2024
- Updated
- Aug 30, 2024