Downloads · 30 days
25
30% of all-time downloads
dranger003/bagel-dpo-8x7b-v0.2-iMat.GGUF
bagel-dpo-8x7b-v0.2-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin?searchmodels=8x7b The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration…
Downloads · 30 days
25
30% of all-time downloads
All-time downloads
82
Public
Repo size
56.3 GB
Likes
2
Public
Click a slice to open those files.
.gguf56.3 GB · 100%
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin?search_models=8x7b
The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a general purpose imatrix calibration dataset.
Other quants available here: https://huggingface.co/Artefact2/bagel-dpo-8x7b-v0.2-GGUF
| Layers | Context | Template |
|---|---|---|
| <pre>32</pre> | <pre>32768</pre> | <pre>[INST] <<SYS>><br>{instructions}<br><</SYS>><br><br>{prompt} [/INST]<br>{response}</pre> |