Downloads · 30 days
32
32% of all-time downloads
miqu-1-120b-iMat.GGUF
dranger003/miqu-1-120b-iMat.GGUF
miqu-1-120b-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf.
GGUF importance matrix (imatrix) quants for https://huggingface.co/wolfram/miqu-1-120b The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
All-time downloads
100
Public
Repo size
114 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf114 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- Access
- Public
- Created
- Feb 18, 2024
- Updated
- Feb 18, 2024
- SHA
- a4e6724d
Try a prompt
Model card
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/wolfram/miqu-1-120b
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
| Layers | Context | Template |
|---|---|---|
| <pre>140</pre> | <pre>32764</pre> | <pre>[INST] {prompt} [/INST]<br>{response}</pre> |
- Task
- Text Generation
- Library
- gguf
- Created
- Feb 18, 2024
- Updated
- Feb 18, 2024