Downloads · 30 days
368
8% of all-time downloads
dranger003/WhiteRabbitNeo-33B-v1.5-iMat.GGUF
WhiteRabbitNeo-33B-v1.5-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
GGUF importance matrix (imatrix) quants for https://huggingface.co/WhiteRabbitNeo/WhiteRabbitNeo-33B-v1.5 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
Downloads · 30 days
368
8% of all-time downloads
All-time downloads
4.8K
Public
Repo size
68 GB
Likes
4
Public
Click a slice to open those files.
.gguf68 GB · 100%
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/WhiteRabbitNeo/WhiteRabbitNeo-33B-v1.5
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
| Layers | Context | Template |
|---|---|---|
| <pre>62</pre> | <pre>16384</pre> | <pre>SYSTEM:<br>{instructions}<br>USER:<br>{prompt}<br>ASSISTANT:<br>{response}</pre> |