Downloads · 30 days
182
3% of all-time downloads
Smaug-Mixtral-v0.1-iMat.GGUF
dranger003/Smaug-Mixtral-v0.1-iMat.GGUF
Smaug-Mixtral-v0.1-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF importance matrix (imatrix) quants for https://huggingface.co/abacusai/Smaug-Mixtral-v0.1 The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration…
All-time downloads
5.4K
Public
Repo size
475 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf288 GB · 61%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Feb 25, 2024
- Updated
- Feb 26, 2024
- SHA
- d48fb6de
Try a prompt
Model card
From the Hugging Face model README
- GGUF importance matrix (imatrix) quants for https://huggingface.co/abacusai/Smaug-Mixtral-v0.1
- The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
- The imatrix is being used on the K-quants as well.
NOTE: The new IQ3_M/IQ3_S (and updated Q3_K_XS) quants have been added, as well as IQ2_S/IQ2_M (requires commit a33e6a0d).
| Layers | Context | Template |
|---|---|---|
| <pre>32</pre> | <pre>32768</pre> | <pre><s>[INST] {prompt} [/INST]<br>{response}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Created
- Feb 25, 2024
- Updated
- Feb 26, 2024