Downloads · 30 days
20
38% of all-time downloads
Mistral-7B-Holodeck-1-exl2
cgus/Mistral-7B-Holodeck-1-exl2
Mistral-7B-Holodeck-1-exl2 is a text generation model from cgus. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Original model: Mistral-7B-Holodeck-1 Model creator: KoboldAI
All-time downloads
53
Public
Repo size
30.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Mar 7, 2024
- Updated
- Mar 28, 2024
- SHA
- 484619e1
Try a prompt
Model card
From the Hugging Face model README
Mistral 7B - Holodeck exl2
Original model: Mistral-7B-Holodeck-1
Model creator: KoboldAI
Quants
4bpw-h6 (main)
4.25bpw-h6
4.65bpw-h6
5bpw-h6
6bpw-h6
8bpw-h8
Quantization notes
Made with exllamav2 0.0.15 with the default dataset.
How to run
This quantization method uses GPU and requires Exllamav2 loader which can be found in following applications:
Original card
Mistral 7B - Holodeck
Model Description
Mistral 7B-Holodeck is a finetune created using Mistral's 7B model.
Training data
The training data contains around 3000 ebooks in various genres.
Most parts of the dataset have been prepended using the following text: [Genre: <genre1>, <genre2>]
### Limitations and Biases
Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion).
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Mar 7, 2024
- Updated
- Mar 28, 2024