Downloads · 30 days
380
3% of all-time downloads
Nexus-IKM-Mistral-7B-GGUF
bartowski/Nexus-IKM-Mistral-7B-GGUF
Nexus-IKM-Mistral-7B-GGUF is a text generation model from bartowski. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Using <a href="https://github.com/ggerganov/llama.cpp/"llama.cpp</a release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b2354"b2354</a for quantization.
All-time downloads
12.9K
Public
Repo size
54.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf54.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Access
- Public
- Created
- Mar 9, 2024
- Updated
- Mar 9, 2024
- SHA
- 04b531dc
Try a prompt
Datasets
Model card
From the Hugging Face model README
Llamacpp Quantizations of Nexus-IKM-Mistral-7B
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b2354">b2354</a> for quantization.
Original model: https://huggingface.co/Severian/Nexus-IKM-Mistral-7B
Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Description |
|---|---|---|---|
| Nexus-IKM-Mistral-7B-Q8_0.gguf | Q8_0 | 7.69GB | Extremely high quality, generally unneeded but max available quant. |
| Nexus-IKM-Mistral-7B-Q6_K.gguf | Q6_K | 5.94GB | Very high quality, near perfect, recommended. |
| Nexus-IKM-Mistral-7B-Q5_K_M.gguf | Q5_K_M | 5.13GB | High quality, very usable. |
| Nexus-IKM-Mistral-7B-Q5_K_S.gguf | Q5_K_S | 4.99GB | High quality, very usable. |
| Nexus-IKM-Mistral-7B-Q5_0.gguf | Q5_0 | 4.99GB | High quality, older format, generally not recommended. |
| Nexus-IKM-Mistral-7B-Q4_K_M.gguf | Q4_K_M | 4.36GB | Good quality, similar to 4.25 bpw. |
| Nexus-IKM-Mistral-7B-Q4_K_S.gguf | Q4_K_S | 4.14GB | Slightly lower quality with small space savings. |
| Nexus-IKM-Mistral-7B-Q4_0.gguf | Q4_0 | 4.10GB | Decent quality, older format, generally not recommended. |
| Nexus-IKM-Mistral-7B-Q3_K_L.gguf | Q3_K_L | 3.82GB | Lower quality but usable, good for low RAM availability. |
| Nexus-IKM-Mistral-7B-Q3_K_M.gguf | Q3_K_M | 3.51GB | Even lower quality. |
| Nexus-IKM-Mistral-7B-Q3_K_S.gguf | Q3_K_S | 3.16GB | Low quality, not recommended. |
| Nexus-IKM-Mistral-7B-Q2_K.gguf | Q2_K | 2.71GB | Extremely low quality, not recommended. |
Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Created
- Mar 9, 2024
- Updated
- Mar 9, 2024