Downloads · 30 days
7
5% of all-time downloads
Mistral-Small-Instruct-2409_exl2_6.8bpw_rpcal_mk2
DeusImperator/Mistral-Small-Instruct-2409_exl2_6.8bpw_rpcal_mk2
Mistral-Small-Instruct-2409_exl2_6.8bpw_rpcal_mk2 is a text generation model from DeusImperator. Use it when you need the model to write or continue text. It is set up for transformers.
This is a 8bpw EXL2 quant of mistralai/Mistral-Small-Instruct-2409
All-time downloads
129
Public
Repo size
19.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors19.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Sep 19, 2024
- Updated
- Sep 19, 2024
- SHA
- c90e8276
Try a prompt
Model card
From the Hugging Face model README
Mistral-Small-Instruct-2409 - EXL2 6.8 rpcal_mk2
This is a 8bpw EXL2 quant of mistralai/Mistral-Small-Instruct-2409
This quant was made using exllamav2-0.2.2 with Fullmoon-light dataset for RP.
I tested this quant shortly in some random RPs (including ones over 8k and 16k context) and it seems to work fine.
Prompt Templates
Uses Mistral format.
For more details see original model.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Sep 19, 2024
- Updated
- Sep 19, 2024