Downloads · 30 days
101
7% of all-time downloads
miqu-1-70b-iMat.GGUF
dranger003/miqu-1-70b-iMat.GGUF
miqu-1-70b-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
GGUF importance matrix (imatrix) quants for https://huggingface.co/152334H/miqu-1-70b-sf The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
All-time downloads
1.5K
Public
Repo size
180 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.gguf107 GB · 59%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- other
- Access
- Public
- Created
- Feb 16, 2024
- Updated
- Mar 22, 2024
- SHA
- 73c3a061
Try a prompt
Model card
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/152334H/miqu-1-70b-sf
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
These quants are based off the second dequantization by 152334H.
| Layers | Context | Template |
|---|---|---|
| <pre>80</pre> | <pre>32764</pre> | <pre><s> [INST] {prompt} [/INST] {response}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- other
- Created
- Feb 16, 2024
- Updated
- Mar 22, 2024