Downloads · 30 days
17
1% of all-time downloads
kaitchup/Mistral-7B-awq-4bit
Mistral-7B-awq-4bit is a text generation model from kaitchup. Use it when you need the model to write or continue text. It is set up for transformers.
Mistral 7B quantized in 4-bit with AutoAWQ.
Downloads · 30 days
17
1% of all-time downloads
All-time downloads
1.6K
Public
Parameters
7.2B
4.2 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors4.2 GB · 100%
How the weights are stored.
I327B · 96%
From the Hugging Face model README
Mistral 7B quantized in 4-bit with AutoAWQ.