Downloads · 30 days
6
13% of all-time downloads
zgce/Mistral-RP-0.1-7B-3.5bpw-hb6-exl2
Mistral-RP-0.1-7B-3.5bpw-hb6-exl2 is a text generation model from zgce. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Model creator: Undi95 - Original model: Mistral-RP-0.1-7B
Downloads · 30 days
6
13% of all-time downloads
All-time downloads
48
Public
Repo size
3.4 GB
Likes
0
Public
Click a slice to open those files.
.safetensors3.4 GB · 100%
From the Hugging Face model README
I converted the model using the convert.py script from the exllamav2 repo: https://github.com/turboderp/exllamav2
Its documentation: https://github.com/turboderp/exllamav2/blob/master/doc/convert.md
I used the WikiText-2-v1 dataset for calibration: https://huggingface.co/datasets/wikitext/blob/refs%2Fconvert%2Fparquet/wikitext-2-v1/test/0000.parquet