Downloads · 30 days
11
10% of all-time downloads
NeuralMonarch-7B-iMat.GGUF
dranger003/NeuralMonarch-7B-iMat.GGUF
NeuralMonarch-7B-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as cc-by-nc-4.0.
GGUF importance matrix (imatrix) quants for https://huggingface.co/mlabonne/NeuralMonarch-7B The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration da…
All-time downloads
114
Public
Repo size
15 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf15 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Feb 23, 2024
- Updated
- Feb 23, 2024
- SHA
- fd3aa4b0
Try a prompt
Model card
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/mlabonne/NeuralMonarch-7B
The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
| Layers | Context | Template |
|---|---|---|
| <pre>32</pre> | <pre>32768</pre> | <pre><s>user<br>{prompt}</s><br><s>assistant<br>{response}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- cc-by-nc-4.0
- Created
- Feb 23, 2024
- Updated
- Feb 23, 2024