Downloads · 30 days
42
13% of all-time downloads
Mistral-22B-v0.2-GGUF
NLPark/Mistral-22B-v0.2-GGUF
Mistral-22B-v0.2-GGUF is a text generation model from NLPark. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
static quantize of https://huggingface.co/Vezora/Mistral-22B-v0.2 iQ Quants can be found here(Richard Erkhov's work): https://huggingface.co/RichardErkhov/Vezora-Mistral-22B-v0.2-gguf
All-time downloads
319
Public
Repo size
50 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf50 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Apr 13, 2024
- Updated
- Apr 13, 2024
- SHA
- 9a421228
Try a prompt
Base models
Model card
From the Hugging Face model README
About
static quantize of https://huggingface.co/Vezora/Mistral-22B-v0.2 iQ Quants can be found here(Richard Erkhov's work): https://huggingface.co/RichardErkhov/Vezora_-_Mistral-22B-v0.2-gguf
Provided Quants
| Filename | Quant type | File Size | Description |
|---|---|---|---|
| Mistral-22B-v0.2-Q5_K_M.gguf | Q5_K_M | 15.71GB | High quality, recommended. |
| Mistral-22B-v0.2-Q4_K_M.gguf | Q4_K_M | 13.33GB | Good quality, uses about 4.83 bits per weight, recommended. |
| Mistral-22B-v0.2-Q4_K_S.gguf | Q4_K_S | 12.65GB | Slightly lower performance than Q4_K_M, fastest, best choice for 16G RAM devices, recommended. |
| Mistral-22B-v0.2-Q3_K_M.gguf | Q3_K_M | 10.75GB | Even lower quality. |
| Mistral-22B-v0.2-Q2_K.gguf | Q2_K | 8.26GB | Very low quality. |
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Created
- Apr 13, 2024
- Updated
- Apr 13, 2024