Downloads · 30 days
0
miquliz-120b-Q4-GGUF
NanoByte/miquliz-120b-Q4-GGUF
miquliz-120b-Q4-GGUF is a machine learning model from NanoByte. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- Model creator: Wolfram Ravenwolf - Original model: miquliz-120b
Access
Public
Updated Feb 6, 2024
Repo size
137 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf-split-a68.7 GB · 50%
At a glance
- Access
- Public
- Created
- Feb 6, 2024
- Updated
- Feb 6, 2024
- SHA
- 046a79cc
Base models
Model card
From the Hugging Face model README
miquliz-120b - Q4 GGUF
- Model creator: Wolfram Ravenwolf
- Original model: miquliz-120b
Description
This repo contains Q4_K_S and Q4_K_M GGUF format model files for Wolfram Ravenwolf's miquliz-120b.
Prompt template: Mistral
[INST] {prompt} [/INST]
Provided files
| Name | Quant method | Bits | Size |
|---|---|---|---|
| miquliz-120b.Q4_K_S.gguf | Q4_K_S | 4 | 66.81 GB |
| miquliz-120b.Q4_K_M.gguf | Q4_K_M | 4 | 70.64 GB |
Note: HF does not support uploading files larger than 50GB. Therefore the files are uploaded as split files.
- Created
- Feb 6, 2024
- Updated
- Feb 6, 2024