Downloads · 30 days
13
4% of all-time downloads
waldie/Mistral-Pygmalion-7b-4bpw-h6-exl2
Mistral-Pygmalion-7b-4bpw-h6-exl2 is a text generation model from waldie. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-nd-4.0.
Downloads · 30 days
13
4% of all-time downloads
All-time downloads
309
Public
Repo size
3.6 GB
Likes
1
Public
Click a slice to open those files.
.safetensors3.6 GB · 100%
From the Hugging Face model README
quant of Delcos' MistralPy-7b
python3 convert.py \
-i /input/Delcos_Mistral-Pygmalion-7b/ \
-c /input/wikitext/0000.parquet \
-o /output/temp/ \
-cf /output/4bpw/ \
-b 4.0 \
-hb 6