Downloads · 30 days
10
16% of all-time downloads
GreenBitAI/Mistral-7B-Instruct-v0.2-layer-mix-bpw-2.2
Mistral-7B-Instruct-v0.2-layer-mix-bpw-2.2 is a text generation model from GreenBitAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is GreenBitAI's pretrained low-bit LLMs with extreme compression yet still strong performance.
Downloads · 30 days
10
16% of all-time downloads
All-time downloads
61
Public
Parameters
942M
8.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.8 GB · 100%
How the weights are stored.
F16474M · 50%
From the Hugging Face model README
This is GreenBitAI's pretrained low-bit LLMs with extreme compression yet still strong performance.
Please refer to our Github page for the code to run the model and more information.