Downloads · 30 days
10
24% of all-time downloads
Mistral-Small-Gutenberg-Doppel-22B_exl2_6.8bpw
DeusImperator/Mistral-Small-Gutenberg-Doppel-22B_exl2_6.8bpw
Mistral-Small-Gutenberg-Doppel-22B_exl2_6.8bpw is a text generation model from DeusImperator. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
42
Public
Repo size
19.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors19.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- mistral
- Access
- Public
- Created
- Sep 27, 2024
- Updated
- Sep 27, 2024
- SHA
- d8fbee69
Try a prompt
Base models
Model card
From the Hugging Face model README
Mistral-Small-Gutenberg-Doppel-22B - EXL2 6.8bpw
This is a 6.8bpw EXL2 quant of nbeerbower/Mistral-Small-Gutenberg-Doppel-22B
This quant was made using exllamav2-0.2.2 with default dataset.
I tested this quant shortly in some random RPs (including some RPs with 8k+ context) and it seems to work fine.
Prompt Templates
Uses Mistral v2/v3 format.
Original readme below
Mistral-Small-Gutenberg-Doppel-22B
mistralai/Mistral-Small-Instruct-2409 finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.
Method
ORPO tuned with an A40 on RunPod (plz sponsor me) for 3 epochs.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- other
- Created
- Sep 27, 2024
- Updated
- Sep 27, 2024